-- Logs begin at Tue 2021-06-01 10:26:48 UTC, end at Tue 2021-06-01 11:32:29 UTC. --
Jun 01 11:01:06.853587 dv-cinder-787764-3-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
Jun 01 11:01:07.818647 dv-cinder-787764-3-iscsi neutron-server[119101]: Beware of the coming changes in the project packaging
Jun 01 11:01:07.819245 dv-cinder-787764-3-iscsi neutron-server[119101]: https://github.com/svinota/pyroute2/discussions/786
Jun 01 11:01:09.262152 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.common.config [-] Logging enabled!
Jun 01 11:01:09.262788 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev249
Jun 01 11:01:09.262921 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=119101) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 11:01:09.268026 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.common.config [-] Logging enabled!
Jun 01 11:01:09.268283 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev249
Jun 01 11:01:09.268601 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=119101) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 11:01:09.269524 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 11:01:09.269757 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 11:01:09.270108 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 11:01:09.270354 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 11:01:09.270579 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 11:01:09.270891 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.271181 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.271474 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.271730 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.272025 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.272312 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.272591 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.272876 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.273166 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.273446 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.273720 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.273999 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.274225 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.274500 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.274783 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.275063 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.275281 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] debug                          = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.275557 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.276002 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.276404 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.276680 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.276962 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.277236 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.277504 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.277781 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.278058 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.278380 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] host                           = dv-cinder-787764-3-iscsi {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.278658 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.278938 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.279220 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.279527 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.279824 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.280096 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.280377 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.280647 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.280916 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.281187 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.281472 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.281756 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.282048 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.282270 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.282490 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.282774 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.283057 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.283328 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.283611 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.283891 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.284160 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.284429 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.284706 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.284969 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.285248 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.285528 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.285796 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.286066 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.286335 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.286604 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.286884 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.287156 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.287426 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.287727 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.288011 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.288277 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.288546 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.288841 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.289124 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.289403 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.289684 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.289954 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.290232 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.290502 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.290770 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.291038 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.291305 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.291572 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.291872 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.292157 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.292411 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.292680 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.292946 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.293224 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:09.293520 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.293813 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.294110 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.294391 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.294683 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.294963 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.295274 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.295555 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.295857 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.296144 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.296429 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.296705 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.296988 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.297261 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.297554 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.297861 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.298151 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.298438 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.298710 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.298978 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.299245 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.299521 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.299827 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.300119 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.300410 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.300678 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.300951 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.301238 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.301515 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.301785 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.302059 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.302344 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.302618 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.302886 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.303161 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.303438 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.303731 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.304002 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.304275 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.304562 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.304836 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.305103 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.305368 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.305641 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.305909 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.306189 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.306463 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.306732 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.306999 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.307271 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.307540 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.307839 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.308113 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.308380 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.308654 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.308921 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.309187 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.309454 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.309720 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.309987 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.310252 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.310516 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.311300 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.311675 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.311866 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.312136 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.312403 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.312671 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.312951 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.313243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.313518 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.313792 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.314065 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.314338 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.314611 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.314884 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.315155 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.315427 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.315713 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.316002 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.316279 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.316560 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.316838 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.317112 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.317402 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.317675 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.317960 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.318231 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.318503 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.318787 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.319066 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.319354 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.319669 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.319962 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.320250 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.320537 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.320809 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.321111 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.321383 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:09.321635 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 11:01:09.321873 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=119101) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
Jun 01 11:01:09.668016 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=119101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:09.668293 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=119101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:09.668582 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=119101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:09.669058 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.manager [-] Loading core plugin: ml2
Jun 01 11:01:10.063618 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.063810 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.064084 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.065274 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.065547 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.065808 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.100766 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.101048 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.101317 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.114564 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.114844 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.115106 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.144678 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.144954 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.145221 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.181201 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.181479 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.181742 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.411890 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f5799c1dee0> agent after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.412524 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f5799c1dee0> agent after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.412524 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7f5799c1de50> segment precommit_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.412693 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7f5799c1ddc0> network precommit_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.413416 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7f5799c3f9d0> segment before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.535431 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> network before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.535771 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7f5799cb00d0> agent before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.536057 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> network before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.536329 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> port before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.536593 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> port before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.536902 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> segment precommit_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.537159 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> segment precommit_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.537411 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> segment after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.537660 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> segment after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.537938 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> network after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.538193 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> network precommit_delete 0 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.538454 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> port provisioning_complete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.538716 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.538969 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> rbac-policy after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.539240 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> agent after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.539508 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> subnet after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.540856 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> subnet precommit_delete 0 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.541151 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.541420 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.541709 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> segment_host_mapping after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.542063 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> port after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.542322 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> port after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.542578 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> port after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.542864 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.543116 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.543363 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f579a556dc0>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.543763 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=119101) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 11:01:10.544003 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=119101) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 11:01:10.544240 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=119101) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 11:01:10.544472 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=119101) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 11:01:10.544704 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=119101) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 11:01:10.544956 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=119101) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 11:01:10.545847 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
Jun 01 11:01:10.548938 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
Jun 01 11:01:10.552796 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Jun 01 11:01:10.556492 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(650, 699)])])
Jun 01 11:01:10.558099 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
Jun 01 11:01:10.558533 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
Jun 01 11:01:10.558866 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
Jun 01 11:01:10.559242 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
Jun 01 11:01:10.562184 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
Jun 01 11:01:10.562436 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
Jun 01 11:01:10.562782 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 11:01:10.589412 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
Jun 01 11:01:10.589853 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7f5799ce18e0>> qos_plugin after_init 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.590143 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=119101) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
Jun 01 11:01:10.590499 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7f5799ce1550>> logging-plugin after_init 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.592362 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=119101) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
Jun 01 11:01:10.592642 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 11:01:10.592888 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
Jun 01 11:01:10.596074 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f5799a7e2e0>> floatingip before_response 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.596352 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f5799a7e2e0>> port before_response 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:10.678616 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Jun 01 11:01:10.678789 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Jun 01 11:01:10.679022 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Jun 01 11:01:10.679412 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
Jun 01 11:01:10.710447 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_db.sqlalchemy.engines [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 01 11:01:11.048202 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Initializing driver for type 'gre'
Jun 01 11:01:11.048595 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] gre ID ranges: [(1, 1000)]
Jun 01 11:01:11.105148 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Initializing driver for type 'local'
Jun 01 11:01:11.105474 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Initializing driver for type 'vlan'
Jun 01 11:01:11.117059 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] VlanTypeDriver initialization complete
Jun 01 11:01:11.117387 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Initializing driver for type 'vxlan'
Jun 01 11:01:11.117882 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] vxlan ID ranges: [(1, 1000)]
Jun 01 11:01:11.168836 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Initializing extension driver 'port_security'
Jun 01 11:01:11.169339 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.extensions.port_security [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] PortSecurityExtensionDriver initialization complete
Jun 01 11:01:11.169807 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Initializing mechanism driver 'openvswitch'
Jun 01 11:01:11.170236 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Initializing mechanism driver 'hyperv'
Jun 01 11:01:11.176613 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.plugins.ml2.plugin [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=119101) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:01:11.177396 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f5799b314f0>> port after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.177760 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f5799b314f0>> port after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.178108 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f5799b314f0>> port after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.178495 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f5799b31520>> subnet after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.178841 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f5799b31520>> subnet after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.179182 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f5799b31520>> subnet after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.179551 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9400>> network after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.179925 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9400>> network after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.180356 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9400>> network after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.180731 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9670>> security_group after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.181072 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9670>> security_group after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.181406 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9670>> security_group after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.181774 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9910>> security_group_rule after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.182110 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9910>> security_group_rule after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.182440 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9910>> security_group_rule after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.182806 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9b80>> address_group after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.183140 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9b80>> address_group after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.183471 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f57995d9b80>> address_group after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.183828 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] ML2 OVO RPC backend initialized. {{(pid=119101) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
Jun 01 11:01:11.184530 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> router_interface after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.184878 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> router_interface after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.185287 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> network before_response 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.185713 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> networks before_response 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.186058 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> port before_response 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.186393 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> ports before_response 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.186731 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> subnet before_response 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.187071 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> subnets before_response 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.187411 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> network after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.187774 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> network after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.188106 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> network after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.188439 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> port after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.188770 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> port after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.189098 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> port after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.189429 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> subnet after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.189756 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> subnet after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.190083 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f57995d9f70>> subnet after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.190643 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.plugin [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Modular L2 Plugin initialization complete
Jun 01 11:01:11.190963 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading services supported by the core plugin {{(pid=119101) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
Jun 01 11:01:11.191287 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.plugins.ml2.managers [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Got port-security extension from driver 'port_security'
Jun 01 11:01:11.191766 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.extensions.vlantransparent [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Disabled vlantransparent extension.
Jun 01 11:01:11.192247 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=119101) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
Jun 01 11:01:11.192555 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading Plugin: router
Jun 01 11:01:11.235571 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router_interface before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.236063 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router after_create 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.236673 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router before_create 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.237097 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router_interface before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.237588 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router_interface after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.238260 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router after_delete 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.238857 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> floatingip after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.239357 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router after_create 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.240045 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router after_update 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.240521 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router after_update 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.240926 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router_gateway after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.241518 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router after_update 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.242044 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router precommit_update 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.242633 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7f5799bf6940> port after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.243089 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7f5799bf6a60> port after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.243620 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7f5799bf69d0> subnet after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.244312 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7f5799bf6820> subnetpool_address_scope after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.244765 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> port precommit_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.245246 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router precommit_create 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.245618 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7f5799beb430> port before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.246075 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router precommit_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.246635 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router after_update 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.246983 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router precommit_delete 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.247335 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router precommit_create 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.247719 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router_interface after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.248581 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> router precommit_update 55549900 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.248952 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f57995d9700>> network after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.249811 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Tracking information for resource: router configured {{(pid=119101) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 11:01:11.250143 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Tracking information for resource: floatingip configured {{(pid=119101) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 11:01:11.255061 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.db.l3_agentschedulers_db [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
Jun 01 11:01:11.255656 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7f5799554e50> port after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.256014 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7f5799554d30> port after_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.256364 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function _notify_port_delete at 0x7f5799554dc0> port after_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.256712 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7f5799556160> port after_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.257506 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f579957d910>> router before_create 55550100 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.257864 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f579957d910>> router precommit_delete 55550100 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.258221 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f579957d910>> router precommit_create 55550100 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.258572 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f579957d910>> router precommit_update 55550100 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.263111 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.services.provider_configuration [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service providers = [] {{(pid=119101) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
Jun 01 11:01:11.263470 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.db.servicetype_db [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=119101) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Jun 01 11:01:11.268198 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.services.service_base [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=119101) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 11:01:11.268548 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.services.service_base [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=119101) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 11:01:11.268888 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.services.service_base [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=119101) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 11:01:11.269744 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.services.service_base [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=119101) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 11:01:11.270110 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.services.service_base [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Default provider is not specified for service type L3_ROUTER_NAT
Jun 01 11:01:11.270646 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=119101) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 11:01:11.270966 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
Jun 01 11:01:11.281376 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=119101) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 11:01:11.281711 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading Plugin: auto_allocate
Jun 01 11:01:11.287418 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f579959f550> network precommit_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.287805 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f579959f550> network precommit_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.288317 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=119101) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 11:01:11.288633 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading Plugin: tag
Jun 01 11:01:11.295344 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=119101) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 11:01:11.295691 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading Plugin: timestamp
Jun 01 11:01:11.299410 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=119101) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 11:01:11.299725 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading Plugin: network_ip_availability
Jun 01 11:01:11.304842 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f5799594ee0>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.305211 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f5799594ee0>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.305565 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f5799594ee0>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.306267 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=119101) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 11:01:11.306584 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading Plugin: flavors
Jun 01 11:01:11.312132 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=119101) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 11:01:11.312455 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading Plugin: revisions
Jun 01 11:01:11.316607 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=119101) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 11:01:11.316992 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_concurrency.lockutils [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.648s {{(pid=119101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:11.317709 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=119101) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
Jun 01 11:01:11.318040 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Initializing extension manager.
Jun 01 11:01:11.318539 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: __init__.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.318878 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: __pycache__ {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.319209 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.319540 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: address_group.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.320296 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.320849 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: address-group
Jun 01 11:01:11.321167 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: address_scope.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.321861 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.322360 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: address-scope
Jun 01 11:01:11.322680 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: admin_state_down_before_update.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.323615 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.324108 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: router-admin-state-down-before-update
Jun 01 11:01:11.324424 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: agent.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.325099 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.325596 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: agent
Jun 01 11:01:11.325913 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: agent_resources_synced.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.327356 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.327878 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: agent-resources-synced
Jun 01 11:01:11.328196 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: allowedaddresspairs.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.329916 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.330433 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: allowed-address-pairs
Jun 01 11:01:11.330762 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: auto_allocated_topology.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.331821 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.332327 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: auto-allocated-topology
Jun 01 11:01:11.332647 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: availability_zone.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.333322 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.333827 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: availability_zone
Jun 01 11:01:11.334148 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: availability_zone_filter.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.335025 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.335526 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: availability_zone_filter
Jun 01 11:01:11.335868 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: data_plane_status.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.336740 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.337235 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension data-plane-status not supported by any of loaded plugins
Jun 01 11:01:11.337551 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: default_subnetpools.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.338431 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.338931 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: default-subnetpools
Jun 01 11:01:11.339246 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: dhcpagentscheduler.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.340058 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.340554 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: dhcp_agent_scheduler
Jun 01 11:01:11.340869 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: dns.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.341769 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.342265 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension dns-integration not supported by any of loaded plugins
Jun 01 11:01:11.342579 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: dns_domain_ports.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.343458 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.343982 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension dns-domain-ports not supported by any of loaded plugins
Jun 01 11:01:11.344298 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: dvr.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.344949 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.345446 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: dvr
Jun 01 11:01:11.345762 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: empty_string_filtering.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.346641 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.347142 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: empty-string-filtering
Jun 01 11:01:11.347458 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.348366 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.348869 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Jun 01 11:01:11.349184 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.350061 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.350561 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Jun 01 11:01:11.350878 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: external_net.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.351789 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.352296 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: external-net
Jun 01 11:01:11.352610 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: extra_dhcp_opt.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.353480 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.353981 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: extra_dhcp_opt
Jun 01 11:01:11.354295 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: extraroute.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.355168 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.355698 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: extraroute
Jun 01 11:01:11.356015 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: extraroute_atomic.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.357018 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.357546 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: extraroute-atomic
Jun 01 11:01:11.357858 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: filter_validation.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.358504 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.358996 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: filter-validation
Jun 01 11:01:11.359309 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: fip_pf_description.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.360383 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.360878 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Jun 01 11:01:11.361195 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: fip_port_details.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.362076 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.362574 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: fip-port-details
Jun 01 11:01:11.362889 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: flavors.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.364122 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.364631 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: flavors
Jun 01 11:01:11.364951 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.366569 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.367095 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Jun 01 11:01:11.367424 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: floatingip_pools.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.368142 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.368651 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: floatingip-pools
Jun 01 11:01:11.368973 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: ip_allocation.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.369861 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.370364 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension ip_allocation not supported by any of loaded plugins
Jun 01 11:01:11.370681 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.371560 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.372088 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: ip-substring-filtering
Jun 01 11:01:11.372407 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: l2_adjacency.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.373816 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.374306 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension l2_adjacency not supported by any of loaded plugins
Jun 01 11:01:11.374620 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: l3.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.375556 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.376092 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: router
Jun 01 11:01:11.376412 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: l3_conntrack_helper.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.378627 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.379149 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Jun 01 11:01:11.379476 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.380394 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.380903 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: ext-gw-mode
Jun 01 11:01:11.381225 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.382195 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.382706 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: l3-ha
Jun 01 11:01:11.383023 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: l3_flavors.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.383928 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.384429 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: l3-flavors
Jun 01 11:01:11.384746 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.385621 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.386123 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: l3-port-ip-change-not-allowed
Jun 01 11:01:11.386438 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: l3agentscheduler.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.387440 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.387980 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: l3_agent_scheduler
Jun 01 11:01:11.388306 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: logging.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.390578 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.391089 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension logging not supported by any of loaded plugins
Jun 01 11:01:11.391411 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: metering.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.392155 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.392724 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: metering
Jun 01 11:01:11.393044 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.394096 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.394605 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: metering_source_and_destination_fields
Jun 01 11:01:11.394932 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: multiprovidernet.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.395981 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.396490 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: multi-provider
Jun 01 11:01:11.396813 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: netmtu.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.397702 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.398204 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: net-mtu
Jun 01 11:01:11.398525 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: netmtu_writable.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.399416 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.399954 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: net-mtu-writable
Jun 01 11:01:11.400272 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: network_availability_zone.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.400919 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.401419 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: network_availability_zone
Jun 01 11:01:11.401734 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: network_ip_availability.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.402793 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.403298 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: network-ip-availability
Jun 01 11:01:11.403644 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: network_segment_range.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.404415 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.404964 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension network-segment-range not supported by any of loaded plugins
Jun 01 11:01:11.405227 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: pagination.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.406181 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.406504 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: pagination
Jun 01 11:01:11.406818 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: port_device_profile.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.407717 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.408219 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: port-device-profile
Jun 01 11:01:11.408535 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.409418 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.409911 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: port-mac-address-regenerate
Jun 01 11:01:11.410227 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.411100 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.411616 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: port-numa-affinity-policy
Jun 01 11:01:11.411939 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: port_resource_request.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.412824 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.413319 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension port-resource-request not supported by any of loaded plugins
Jun 01 11:01:11.413637 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: portbindings.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.414531 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.415026 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: binding
Jun 01 11:01:11.415341 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: portbindings_extended.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.416595 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.417099 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: binding-extended
Jun 01 11:01:11.417418 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: portsecurity.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.418299 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.418799 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: port-security
Jun 01 11:01:11.419116 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: project_id.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.420134 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.420458 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: project-id
Jun 01 11:01:11.420773 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: providernet.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.421657 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.422158 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: provider
Jun 01 11:01:11.422472 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: qos.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.425911 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.426428 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension qos not supported by any of loaded plugins
Jun 01 11:01:11.426758 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.427999 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.428509 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Jun 01 11:01:11.428832 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.429715 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.430220 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Jun 01 11:01:11.430539 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: qos_default.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.431421 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.431964 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension qos-default not supported by any of loaded plugins
Jun 01 11:01:11.432285 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: qos_fip.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.432918 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.433420 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension qos-fip not supported by any of loaded plugins
Jun 01 11:01:11.433737 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: qos_gateway_ip.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.434629 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.435133 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension qos-gateway-ip not supported by any of loaded plugins
Jun 01 11:01:11.436197 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: qos_port_network_policy.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.436879 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.437377 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension qos-port-network-policy not supported by any of loaded plugins
Jun 01 11:01:11.437695 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: qos_rule_type_details.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.438575 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.439070 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension qos-rule-type-details not supported by any of loaded plugins
Jun 01 11:01:11.439386 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: qos_rules_alias.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.440417 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.440918 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension qos-rules-alias not supported by any of loaded plugins
Jun 01 11:01:11.441236 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: quotasv2.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.442223 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.442545 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: quotas
Jun 01 11:01:11.442862 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: quotasv2_detail.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.444486 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.444819 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: quota_details
Jun 01 11:01:11.445141 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: rbac.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.446167 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.446683 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: rbac-policies
Jun 01 11:01:11.447005 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: rbac_address_group.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.447930 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.448441 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: rbac-address-group
Jun 01 11:01:11.448762 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: rbac_address_scope.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.449648 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.450153 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: rbac-address-scope
Jun 01 11:01:11.450471 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: rbac_security_groups.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.451909 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.452413 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: rbac-security-groups
Jun 01 11:01:11.452734 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: rbac_subnetpool.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.453614 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.454115 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: rbac-subnetpool
Jun 01 11:01:11.454443 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: revisionifmatch.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.455333 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.455866 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: revision-if-match
Jun 01 11:01:11.456184 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: revisions.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.457256 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.457758 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: standard-attr-revisions
Jun 01 11:01:11.458080 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: router_availability_zone.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.458734 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.459236 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: router_availability_zone
Jun 01 11:01:11.459554 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: routerservicetype.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.460462 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.460969 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension router-service-type not supported by any of loaded plugins
Jun 01 11:01:11.461283 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.462173 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.462688 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: security-groups-normalized-cidr
Jun 01 11:01:11.463005 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: security_groups_port_filtering.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.463929 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.464440 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: port-security-groups-filtering
Jun 01 11:01:11.464756 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.465643 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.466142 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: security-groups-remote-address-group
Jun 01 11:01:11.466455 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: securitygroup.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.475786 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.476308 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: security-group
Jun 01 11:01:11.476631 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: segment.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.477391 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.477890 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension segment not supported by any of loaded plugins
Jun 01 11:01:11.478209 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.479117 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.479645 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Jun 01 11:01:11.479966 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: servicetype.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.481060 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.481554 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: service-type
Jun 01 11:01:11.481872 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: sorting.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.482844 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.483249 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: sorting
Jun 01 11:01:11.483574 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: standard_attr_segment.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.484477 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.484981 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension standard-attr-segment not supported by any of loaded plugins
Jun 01 11:01:11.485303 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: standardattrdescription.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.485924 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.486420 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: standard-attr-description
Jun 01 11:01:11.486735 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: stateful_security_group.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.487653 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.488156 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: stateful-security-group
Jun 01 11:01:11.488478 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: stdattrs_common.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.489036 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Jun 01 11:01:11.489352 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.490314 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.490814 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
Jun 01 11:01:11.491127 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: subnet_onboard.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.492226 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.492739 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: subnet_onboard
Jun 01 11:01:11.493057 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.494030 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.494538 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Jun 01 11:01:11.494858 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: subnet_service_types.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.495872 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.496384 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: subnet-service-types
Jun 01 11:01:11.496704 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: subnetallocation.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.497766 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.498790 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: subnet_allocation
Jun 01 11:01:11.499109 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.499791 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.500289 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: subnetpool-prefix-ops
Jun 01 11:01:11.500603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.501498 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.501996 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Jun 01 11:01:11.502311 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: tagging.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.503339 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.503872 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: standard-attr-tag
Jun 01 11:01:11.504196 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: timestamp.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.505361 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.505868 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loaded extension: standard-attr-timestamp
Jun 01 11:01:11.506191 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: trunk.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.507189 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.507734 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension trunk not supported by any of loaded plugins
Jun 01 11:01:11.508048 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: trunk_details.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.508937 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.509435 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension trunk-details not supported by any of loaded plugins
Jun 01 11:01:11.509756 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: uplink_status_propagation.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.510640 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.511141 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension uplink-status-propagation not supported by any of loaded plugins
Jun 01 11:01:11.511461 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Loading extension file: vlantransparent.py {{(pid=119101) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 11:01:11.512131 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=119101) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 11:01:11.512627 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extension vlan-transparent not supported by any of loaded plugins
Jun 01 11:01:11.515896 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:network
Jun 01 11:01:11.516602 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:subnet
Jun 01 11:01:11.518392 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 11:01:11.519011 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:port
Jun 01 11:01:11.520300 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.520733 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service FLAVORS assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.521344 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.521781 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.522106 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:router
Jun 01 11:01:11.522760 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 11:01:11.523449 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service METERING assigned prefix: /metering {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.524876 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f5799475430>> rbac-policy before_create 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.525240 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f5799475430>> rbac-policy before_update 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.525586 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f5799475430>> rbac-policy before_delete 55550000 {{(pid=119101) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:01:11.526729 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 11:01:11.527169 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:security_group
Jun 01 11:01:11.527855 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 11:01:11.528570 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service CORE assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.528897 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 11:01:11.529228 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] subnetpool is already registered
Jun 01 11:01:11.529907 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service CORE assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.530230 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 11:01:11.530548 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] subnetpool is already registered
Jun 01 11:01:11.533101 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.533526 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service FLAVORS assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.534113 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.534524 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.534850 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:router
Jun 01 11:01:11.535174 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] router is already registered
Jun 01 11:01:11.535797 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 11:01:11.536117 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] floatingip is already registered
Jun 01 11:01:11.536736 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service METERING assigned prefix: /metering {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.537404 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 11:01:11.537723 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] rbac_policy is already registered
Jun 01 11:01:11.538253 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:security_group
Jun 01 11:01:11.538582 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] security_group is already registered
Jun 01 11:01:11.539164 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 11:01:11.539496 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] security_group_rule is already registered
Jun 01 11:01:11.540189 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service CORE assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.540512 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 11:01:11.540829 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] subnetpool is already registered
Jun 01 11:01:11.541412 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.v2.resource_helper [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Service CORE assigned prefix:  {{(pid=119101) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 11:01:11.541734 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 11:01:11.542046 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING neutron.quota.resource_registry [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] subnetpool is already registered
Jun 01 11:01:11.542664 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: extensions {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.544183 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: address-groups {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.545823 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: address-scopes {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.547028 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: agents {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.548201 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: auto-allocated-topology {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.549488 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: availability_zones {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.550747 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: dhcp-networks {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.552193 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: dhcp-agents {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.553602 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: routers {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.555386 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: flavors {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.556575 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: service_profiles {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.557781 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: next_providers {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.559291 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: service_profiles {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.561301 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: floatingip-pools {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.562502 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: routers {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.564327 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: floatingips {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.565510 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: l3-routers {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.566887 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: l3-agents {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.568383 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: metering-labels {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.569714 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: metering-label-rules {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.571000 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: network-ip-availabilities {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.572273 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: bindings {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.573923 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: quotas {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.575334 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: quotas {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.577298 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: rbac-policies {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.578574 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: security-groups {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.579807 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: security-group-rules {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.581043 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: service-providers {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.582248 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: subnetpools {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.584653 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: subnetpools {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.586094 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.587806 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.702049 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.703864 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.705650 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.707509 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.709214 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.711119 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.712908 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.714766 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron.api.extensions [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Extended resource: tags {{(pid=119101) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 11:01:11.720665 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING keystonemiddleware.auth_token [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
Jun 01 11:01:11.725406 dv-cinder-787764-3-iscsi neutron-server[119101]: WARNING keystonemiddleware.auth_token [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Jun 01 11:01:11.734127 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_concurrency.lockutils [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Acquired lock "singleton_lock" {{(pid=119101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
Jun 01 11:01:11.734603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_concurrency.lockutils [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Releasing lock "singleton_lock" {{(pid=119101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
Jun 01 11:01:11.735227 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO oslo_service.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Starting 2 workers
Jun 01 11:01:11.739909 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Started child 119240 {{(pid=119101) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 11:01:11.744171 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Started child 119241 {{(pid=119101) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 11:01:11.745272 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:11.745923 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO neutron.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Neutron service started, listening on 0.0.0.0:9696
Jun 01 11:01:11.746685 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Notify callbacks [] for process, before_spawn {{(pid=119101) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:11.747501 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [-] (119240) wsgi starting up on http://0.0.0.0:9696
Jun 01 11:01:11.749679 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:11.750180 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO oslo_service.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Starting 1 workers
Jun 01 11:01:11.751085 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [-] (119241) wsgi starting up on http://0.0.0.0:9696
Jun 01 11:01:11.754798 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Started child 119242 {{(pid=119101) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 11:01:11.755306 dv-cinder-787764-3-iscsi neutron-server[119101]: INFO oslo_service.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Starting 1 workers
Jun 01 11:01:11.758399 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] calling RpcWorker wait() {{(pid=119242) _wait /opt/stack/neutron/neutron/service.py:128}}
Jun 01 11:01:11.758915 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] returning from RpcWorker wait() {{(pid=119242) _wait /opt/stack/neutron/neutron/service.py:135}}
Jun 01 11:01:11.759664 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Started child 119243 {{(pid=119101) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 11:01:11.760282 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:11.760426 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG neutron_lib.callbacks.manager [None req-142b8189-fc70-4e95-90ab-0692eeb84a58 None None] Notify callbacks [] for process, after_spawn {{(pid=119101) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:11.760886 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:01:11.762343 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=119101) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 11:01:11.762550 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 11:01:11.762726 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 11:01:11.762946 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 11:01:11.763290 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 11:01:11.763459 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 11:01:11.764271 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.764550 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.764833 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.764931 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:11.765390 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.765390 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.765899 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.766135 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.766398 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.766678 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.766924 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.767096 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.767266 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.767536 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.767795 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.768102 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.768367 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.768619 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.768889 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.769078 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.769315 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.769559 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.769810 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.770072 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] debug                          = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.770318 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.770815 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.771038 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.771278 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.771525 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.771812 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.772056 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.772350 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.772581 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.772809 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.773041 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.773312 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.773545 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.773771 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.773974 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.774216 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.774427 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.774901 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] host                           = dv-cinder-787764-3-iscsi {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.775134 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.775346 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.775609 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.775882 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.776111 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.776339 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.776591 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.776846 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.777085 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.777320 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.777568 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.777794 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.778029 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.778282 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.778439 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.778652 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.778944 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.779210 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.779506 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.779705 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.779868 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.780049 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.780212 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.780474 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.780688 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.780901 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.781117 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.781351 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.781595 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.781830 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.782065 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.782307 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.782538 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.782781 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.783006 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.783244 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.783469 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.783712 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.783922 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.784158 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.784401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.784602 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.784818 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.785026 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.785287 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.785499 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.785743 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.785974 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.786335 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.786564 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.787656 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.787855 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.788344 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.788502 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.788749 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.789036 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.789271 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.789511 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.789665 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:01:11.789813 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.789963 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.790188 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.790446 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.790645 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.790906 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.791134 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.791374 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.791661 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.791825 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.792071 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.792540 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.792823 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.793137 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.793389 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.793780 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.793943 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.794302 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.794492 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.794639 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.795561 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.795981 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.795981 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.796324 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.796479 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.796676 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.797005 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.797258 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.797556 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.797780 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.798036 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.799685 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.799685 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.799685 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.799685 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.799685 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.74/identity {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.799685 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.800100 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.800100 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.800336 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.800525 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.800770 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.801005 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.801287 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.801541 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.801753 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.802054 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.802348 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.802568 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.802805 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.803053 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.803296 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.803925 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.803925 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.804147 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.804228 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.804400 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.804640 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.804869 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.805109 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.805374 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.805608 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.805832 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.806052 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.806293 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.806516 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.806757 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.806977 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.807196 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.807417 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.807656 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.807891 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.808146 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.808374 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.808592 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.808807 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.809029 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.809267 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.809502 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.809744 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.809958 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.810176 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.810410 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.811328 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.811553 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.811816 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.812039 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.812274 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.812524 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.812766 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.812984 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.813199 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.813417 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.813651 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.813886 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.814180 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.814511 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.814757 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.815021 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.815260 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.815528 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.815808 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.816073 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.816314 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.816556 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.816781 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.817033 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.817258 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.817513 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.817742 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.817998 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.818227 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.818465 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.818743 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.818977 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.819217 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.819470 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.819802 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.820067 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.820322 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.820594 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.820835 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.821116 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.821362 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.821774 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.821889 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.822128 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.822421 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.822711 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.822953 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.823197 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.823424 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.823700 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.823932 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.824189 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.824420 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.824645 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.824859 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.825137 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.825380 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.825620 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.825836 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.826070 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.826409 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.826667 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.826882 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.827096 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.827377 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.827648 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.827890 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.828164 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.828428 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.828721 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.828938 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.829194 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.74/identity {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.829429 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.829644 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.829907 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.830122 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.830356 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.830587 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.830822 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.831054 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.831270 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.831524 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.831763 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.831982 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.832215 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.832433 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.832660 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.832908 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.833124 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.833344 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.833595 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.833822 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.834042 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.834263 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.834476 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.834742 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.834962 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.835247 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.835493 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.835760 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.836004 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.836266 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.836505 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.836720 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.836966 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.837187 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.837400 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.837630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.837852 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.838063 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.838291 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.838537 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.838908 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.839181 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.839421 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.839759 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.840013 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.840251 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.840500 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.840718 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.840953 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.841202 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.841544 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.841818 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.842092 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.842247 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.842518 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.842760 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.842983 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.843196 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.843411 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.843660 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.843897 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.844108 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.844401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.844644 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.844890 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.845127 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.845366 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.845594 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.845806 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.846015 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.846326 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.846462 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.846706 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.846935 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.847147 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.847362 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.847572 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.847815 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.848024 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.848235 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.848449 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.848660 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.848903 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.849110 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.849319 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.849541 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.849747 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.850055 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.850308 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.850550 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.850842 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.851089 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.851328 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.851622 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.851961 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.852267 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.852474 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.852657 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.852874 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.853117 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.853372 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.853688 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.854001 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.854266 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.854531 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.854800 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.855085 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:650:699'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.855358 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.855572 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.855885 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.856232 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.856521 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.856777 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.857006 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.857284 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.858038 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.858256 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.858478 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.858717 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.858933 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.859195 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.859446 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.859768 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.859989 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.860219 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.860437 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.860679 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.860948 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.861214 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.861431 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.861589 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 11:01:11.862147 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=119101) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 11:01:11.862425 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 11:01:11.862425 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 11:01:11.862617 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 11:01:11.862785 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 11:01:11.862939 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 11:01:11.863145 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.863306 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.863453 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.863621 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.863784 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.863964 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.864123 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.864282 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.864439 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.864595 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.864753 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.864896 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.865055 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.865212 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.865369 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.865526 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.865682 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.865839 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.866000 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.866158 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.866316 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.866458 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.866721 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] debug                          = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.866863 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.866989 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.867141 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.867268 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.867393 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.867519 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.867718 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.867848 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.867974 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.868120 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.868277 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.868434 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.868591 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.868748 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.868907 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.869050 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.869208 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.869365 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] host                           = dv-cinder-787764-3-iscsi {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.869522 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.869679 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.869836 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.869993 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.870150 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.870372 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.870539 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.870702 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.871970 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.871970 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.871970 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.871970 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.871970 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.871970 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.871970 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.871970 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.873707 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.873707 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.873707 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.873707 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.873707 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.873707 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.873707 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.874195 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.874195 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.874195 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.874195 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.874487 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.874487 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.874638 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.874747 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.874924 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.875063 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.875260 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.875363 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.875517 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.875850 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.875850 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.876121 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.876121 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.876271 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.876422 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.876583 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.876743 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.876895 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.877050 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.877207 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.877364 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.877521 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.877677 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.877836 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.877990 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.878207 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.878370 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.878531 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.878690 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.878894 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.878998 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.879150 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.879307 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.879484 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.879673 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.879831 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.879988 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.880147 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.880307 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.880461 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.880617 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.880778 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 11:01:11.880953 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.881115 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.881288 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.881448 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.881609 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.881773 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.881929 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.882093 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.882253 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.882415 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.882582 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.882742 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.882911 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.883070 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.883231 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.883393 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.883553 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.883735 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.883896 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.884057 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.884217 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.884375 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.884550 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.884712 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.884873 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.74/identity {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.885032 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.885192 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.885353 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.885515 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.885675 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.885835 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.885995 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.886156 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.886317 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.886477 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.886637 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.886798 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.886958 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.887147 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.887277 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.887440 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.887612 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.887778 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.887938 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.888097 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.888258 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.888421 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.888576 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.888778 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.888925 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.889349 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.889511 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.889671 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.889819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.889964 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.890196 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.890293 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.890419 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.890578 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.890739 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.890897 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.891070 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.891161 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:01:11.891257 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.891383 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.891542 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.891739 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.891899 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.892058 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.892218 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.892376 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.892535 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.892696 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.892856 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.893015 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.893173 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.893334 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.893493 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.893653 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.893813 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.893972 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.894131 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.894289 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.894448 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.894606 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.894775 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.894948 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.895108 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.895267 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.895427 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.895603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.895763 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.895923 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.896084 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.896243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.896403 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.896562 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.896721 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.896883 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.897043 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.897202 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.897362 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.897521 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.897680 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.897839 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.898000 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.898159 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.898318 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.898477 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.898634 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.898793 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.898952 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.899121 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.899280 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.899442 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.899620 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.899782 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.899950 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.900110 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.900274 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.900436 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.900593 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.900752 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.900911 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.901070 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.901229 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.901394 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.901553 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.901718 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.901887 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.902121 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.902286 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.902454 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.902630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.902797 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.902946 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.903115 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.903271 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.903575 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.903749 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.903913 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.904075 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.904275 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.904738 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.904738 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.74/identity {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.904738 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907243 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907851 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907851 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907851 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907851 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907851 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907851 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907851 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.907851 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908401 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908957 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908957 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908957 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.908957 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.909234 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.909234 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.909381 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.909496 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.909657 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.909820 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.909984 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.910142 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.910301 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.910463 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.910626 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.910788 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.910950 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.911107 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.911285 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.911449 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.911647 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.911812 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.911974 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.912135 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.912294 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.912457 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.912620 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.912784 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.912946 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.913112 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.913272 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.913434 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.913598 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.913758 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.913918 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.914079 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.914239 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.914412 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.914568 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.914728 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.914891 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.919630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.919630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.919630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.919630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.919630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.919630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.919630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.919630 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.920819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.920819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.920819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.920819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.920819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.920819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.920819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.920819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.920819 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.921436 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.921436 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.921436 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.921436 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.921436 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.921436 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.921436 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.921436 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922053 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922053 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922053 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922053 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922053 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922053 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922053 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922053 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.922603 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:650:699'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923165 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923165 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923165 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923165 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923165 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923165 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923165 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923165 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923165 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923813 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923813 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923813 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923813 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.923813 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.924167 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.924167 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.924313 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.924402 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.924514 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.924678 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.924835 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.924994 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.925154 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 11:01:11.925308 dv-cinder-787764-3-iscsi neutron-server[119101]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=119101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 11:01:12.024555 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 55144) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:12.033535 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [-] 10.222.0.74 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0069027
Jun 01 11:01:22.848346 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b766771d-52e6-4e99-819b-ea31a5741b1d None None] get_active_networks_info from dv-cinder-787764-3-iscsi {{(pid=119242) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
Jun 01 11:01:22.935732 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b766771d-52e6-4e99-819b-ea31a5741b1d None None] No non-hosted networks {{(pid=119242) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
Jun 01 11:01:22.949019 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.agentschedulers_db [None req-b766771d-52e6-4e99-819b-ea31a5741b1d None None] DHCP Agent not found on host dv-cinder-787764-3-iscsi {{(pid=119242) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
Jun 01 11:01:23.070671 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-47742e21-70a2-4b3f-ad23-33fe49ca91ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366'] for agent, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:25.218352 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-d2527d64-a369-4275-b7d9-c7f955aae4fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366'] for agent, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:25.298517 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-478f8c70-6439-494a-8281-54e10cc87f14 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:25.323330 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366'] for agent, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:25.324187 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.324631 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.325074 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.326355 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.329140 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.332463 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.336018 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.337118 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.337579 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.340062 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.340466 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.340844 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:25.341329 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f5799139640>, 'Open vSwitch agent', 'dv-cinder-787764-3-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:01:25.352426 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f5799164940>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-787764-3-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:01:26.368975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366'] for agent, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:27.707383 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366'] for agent, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:29.446879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 55236) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:30.042823 dv-cinder-787764-3-iscsi neutron-server[119241]: WARNING oslo_policy.policy [None req-3d45e4df-b7d6-4f2e-a281-e556593afdc3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 11:01:30.043440 dv-cinder-787764-3-iscsi neutron-server[119241]: WARNING oslo_policy.policy [None req-3d45e4df-b7d6-4f2e-a281-e556593afdc3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 11:01:30.187804 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.db.l3_hamode_db [None req-0244c563-5735-4d40-ae9f-286c947d45b7 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
Jun 01 11:01:30.260695 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [None req-3d45e4df-b7d6-4f2e-a281-e556593afdc3 admin admin] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119241) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:01:30.264046 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-3d45e4df-b7d6-4f2e-a281-e556593afdc3 admin admin] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8138916
Jun 01 11:01:30.274017 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0244c563-5735-4d40-ae9f-286c947d45b7 None None] Routers set() bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:01:30.274345 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0244c563-5735-4d40-ae9f-286c947d45b7 None None] Router IDs set() for agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
Jun 01 11:01:32.579390 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 55250) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:32.942669 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-2033a89f-a0ab-4c2e-a18d-998a06bfe48d admin admin] Request body: {'subnetpool': {'shared': True, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'is_default': True, 'default_prefixlen': 26}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:01:33.042238 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.policy [None req-2033a89f-a0ab-4c2e-a18d-998a06bfe48d admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=119241) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 11:01:33.086826 dv-cinder-787764-3-iscsi neutron-server[119241]: WARNING oslo_policy.policy [None req-2033a89f-a0ab-4c2e-a18d-998a06bfe48d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 11:01:33.087200 dv-cinder-787764-3-iscsi neutron-server[119241]: WARNING oslo_policy.policy [None req-2033a89f-a0ab-4c2e-a18d-998a06bfe48d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 11:01:33.096102 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.quota [None req-2033a89f-a0ab-4c2e-a18d-998a06bfe48d admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f5798eccb20>.
Jun 01 11:01:33.112141 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-2033a89f-a0ab-4c2e-a18d-998a06bfe48d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:01:33.172955 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2033a89f-a0ab-4c2e-a18d-998a06bfe48d admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750893393355', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750893392719', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750893369669', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750893376753', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750893419380', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750893425277', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-3754882', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3794688', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-599346', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-574623'] for rbac-policy, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:33.237012 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2033a89f-a0ab-4c2e-a18d-998a06bfe48d admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:33.238403 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-2033a89f-a0ab-4c2e-a18d-998a06bfe48d admin admin] 10.222.0.74 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.6579149
Jun 01 11:01:35.818375 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 55264) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:36.165628 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Request body: {'network': {'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'name': 'private', 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'admin_state_up': True}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:01:36.170905 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:01:36.175357 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Usage tracker for resource:network and tenant:9568ccfdb70e43a3824aab31b740cc86 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:01:36.179954 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:01:36.186108 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:01:36.195365 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Made reservation on behalf of 9568ccfdb70e43a3824aab31b740cc86 for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:01:36.198161 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:36.215730 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:36.230176 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:01:36.234387 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Usage tracker for resource:security_group_rule and tenant:9568ccfdb70e43a3824aab31b740cc86 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:01:36.239395 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:01:36.245292 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:01:36.343391 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:36.347095 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:36.352256 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:36.370218 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 650}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:01:36.396389 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8750888656357', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:36.396989 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f5799c1de50> segment precommit_create {{(pid=119241) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 11:01:36.397463 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Added segment c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72 of type vlan for network 3fb4a008-f948-4246-aa0a-5f13577f6796
Jun 01 11:01:36.445114 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45e14260-0c18-4f33-9ca0-ff95ba65bbfc,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:36.466974 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.467322 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.467680 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.468006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.468324 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.468655 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.468964 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.469293 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.469626 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.469936 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.470244 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.470547 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Tracked resource versions report:
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]: pushed versions:
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]: {   'AddressGroup': {'1.2'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'ConntrackHelper': {'1.0'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Log': {'1.0'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Network': {'1.1'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Port': {'1.7'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'PortForwarding': {'1.2'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'QosPolicy': {'1.8'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'SecurityGroup': {'1.4'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'SecurityGroupRule': {'1.2'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'SubPort': {'1.0'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Subnet': {'1.1'},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Trunk': {'1.1'}}
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]: consumer versions:
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]: {   DHCP agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     L3 agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     Metadata agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     Metering agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:     Open vSwitch agent@dv-cinder-787764-3-iscsi: {   'AddressGroup': '1.2',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'ConntrackHelper': '1.0',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Log': '1.0',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Network': '1.1',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Port': '1.7',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'PortForwarding': '1.2',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'QosPolicy': '1.8',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'SecurityGroup': '1.4',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'SecurityGroupRule': '1.2',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'SubPort': '1.0',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Subnet': '1.1',
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Trunk': '1.1'}}
Jun 01 11:01:36.471648 dv-cinder-787764-3-iscsi neutron-server[119241]:  {{(pid=119241) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 11:01:36.517259 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:36.524709 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:36.558219 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:36.559604 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:01:36.560249 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:36.564696 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:36.665464 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 0.8460283
Jun 01 11:01:36.668538 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Pushing event updated for resources: {'Network': ['ID=3fb4a008-f948-4246-aa0a-5f13577f6796,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:36.672052 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:36.680655 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 3fb4a008-f948-4246-aa0a-5f13577f6796 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:01:39.313237 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 55280) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:39.890044 dv-cinder-787764-3-iscsi neutron-server[119240]: WARNING oslo_policy.policy [None req-bc492958-dbcf-42ab-825d-a7a919afa828 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 11:01:39.890620 dv-cinder-787764-3-iscsi neutron-server[119240]: WARNING oslo_policy.policy [None req-bc492958-dbcf-42ab-825d-a7a919afa828 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 11:01:40.325715 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.policy [None req-bc492958-dbcf-42ab-825d-a7a919afa828 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=119240) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 11:01:40.370161 dv-cinder-787764-3-iscsi neutron-server[119240]: WARNING oslo_policy.policy [None req-bc492958-dbcf-42ab-825d-a7a919afa828 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 11:01:40.370537 dv-cinder-787764-3-iscsi neutron-server[119240]: WARNING oslo_policy.policy [None req-bc492958-dbcf-42ab-825d-a7a919afa828 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 11:01:40.378686 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc492958-dbcf-42ab-825d-a7a919afa828 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:01:40.380545 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-bc492958-dbcf-42ab-825d-a7a919afa828 admin admin] 10.222.0.74 "GET /v2.0/networks/3fb4a008-f948-4246-aa0a-5f13577f6796 HTTP/1.1" status: 200  len: 825 time: 1.0653355
Jun 01 11:01:40.413177 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-4c76ef85-faf2-43c9-9554-d51ca5d14f14 admin admin] 10.222.0.74 "GET /v2.0/subnetpools/08f28881-8ca9-4663-8194-f35f5aee2850 HTTP/1.1" status: 200  len: 734 time: 0.0274153
Jun 01 11:01:40.421578 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'subnetpool_id': '08f28881-8ca9-4663-8194-f35f5aee2850', 'ip_version': 4, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:01:40.423166 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.quota [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f5799200310>.
Jun 01 11:01:40.429119 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:01:40.434838 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Usage tracker for resource:subnet and tenant:9568ccfdb70e43a3824aab31b740cc86 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:01:40.438214 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:01:40.445206 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:01:40.459420 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Made reservation on behalf of 9568ccfdb70e43a3824aab31b740cc86 for: {'subnet': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:01:40.462181 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Notify callbacks [] for subnet, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:40.956345 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:40.961978 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:41.040736 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Checking segment: {'id': 'c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 650, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:01:41.041108 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Network hostable DHCP agents. Network: 3fb4a008-f948-4246-aa0a-5f13577f6796, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119240) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:01:41.048736 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9a4bba74-ed05-4f1e-8b2a-c893d662d3dd,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:41.059330 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.059704 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.060041 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.060366 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.060687 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.061026 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.061347 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.061680 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.062014 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.062330 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.062642 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.062949 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Tracked resource versions report:
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]: pushed versions:
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]: {   'AddressGroup': {'1.2'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'ConntrackHelper': {'1.0'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Log': {'1.0'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Network': {'1.1'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Port': {'1.7'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'PortForwarding': {'1.2'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'QosPolicy': {'1.8'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'SecurityGroup': {'1.4'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'SecurityGroupRule': {'1.2'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'SubPort': {'1.0'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Subnet': {'1.1'},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Trunk': {'1.1'}}
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]: consumer versions:
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]: {   DHCP agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     L3 agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     Metadata agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     Metering agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:     Open vSwitch agent@dv-cinder-787764-3-iscsi: {   'AddressGroup': '1.2',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'ConntrackHelper': '1.0',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Log': '1.0',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Network': '1.1',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Port': '1.7',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'PortForwarding': '1.2',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'QosPolicy': '1.8',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'SecurityGroup': '1.4',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'SecurityGroupRule': '1.2',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'SubPort': '1.0',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Subnet': '1.1',
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Trunk': '1.1'}}
Jun 01 11:01:41.064047 dv-cinder-787764-3-iscsi neutron-server[119240]:  {{(pid=119240) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 11:01:41.095756 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Network 3fb4a008-f948-4246-aa0a-5f13577f6796 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119240) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:01:41.099692 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:41.108264 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 3fb4a008-f948-4246-aa0a-5f13577f6796) {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:01:41.112852 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:01:41.113508 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:41.118221 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91ed7973-476c-438f-a158-011c2d077afa None None] Network 3fb4a008-f948-4246-aa0a-5f13577f6796 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:01:41.137758 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.7194927
Jun 01 11:01:41.428255 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-3fb4a008-f948-4246-aa0a-5f13577f6796', 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'fixed_ips': [{'subnet_id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:01:41.429489 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:41.611256 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Allocated IP 172.20.0.2 (3fb4a008-f948-4246-aa0a-5f13577f6796/9a4bba74-ed05-4f1e-8b2a-c893d662d3dd/d48892bd-0ec5-49d9-8bf0-333fa7580d64) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:01:41.849292 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:41.862508 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Transition to ACTIVE for port object d48892bd-0ec5-49d9-8bf0-333fa7580d64 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:01:41.881792 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Transition to ACTIVE for port object d48892bd-0ec5-49d9-8bf0-333fa7580d64 will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:01:41.889754 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:41.895278 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:41.954520 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Network 3fb4a008-f948-4246-aa0a-5f13577f6796 is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:01:41.957435 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:01:41.960922 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:01:42.010433 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Pushing event updated for resources: {'Port': ['ID=d48892bd-0ec5-49d9-8bf0-333fa7580d64,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:42.049198 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.049563 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.049907 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.050236 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.050558 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.050879 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.051194 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.051510 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.051863 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.052182 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.052499 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.052808 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Tracked resource versions report:
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]: pushed versions:
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]: {   'AddressGroup': {'1.2'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'ConntrackHelper': {'1.0'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Log': {'1.0'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Network': {'1.1'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Port': {'1.7'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'PortForwarding': {'1.2'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'QosPolicy': {'1.8'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'SecurityGroup': {'1.4'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'SecurityGroupRule': {'1.2'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'SubPort': {'1.0'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Subnet': {'1.1'},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Trunk': {'1.1'}}
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]: consumer versions:
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]: {   DHCP agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     L3 agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     Metadata agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     Metering agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:     Open vSwitch agent@dv-cinder-787764-3-iscsi: {   'AddressGroup': '1.2',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'ConntrackHelper': '1.0',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Log': '1.0',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Network': '1.1',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Port': '1.7',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'PortForwarding': '1.2',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'QosPolicy': '1.8',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'SecurityGroup': '1.4',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'SecurityGroupRule': '1.2',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'SubPort': '1.0',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Subnet': '1.1',
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Trunk': '1.1'}}
Jun 01 11:01:42.053913 dv-cinder-787764-3-iscsi neutron-server[119242]:  {{(pid=119242) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 11:01:42.068308 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:42.072230 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Attempting to bind port d48892bd-0ec5-49d9-8bf0-333fa7580d64 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:01:42.072629 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Attempting to bind port d48892bd-0ec5-49d9-8bf0-333fa7580d64 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 650, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:01:42.073052 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Attempting to bind port d48892bd-0ec5-49d9-8bf0-333fa7580d64 on network 3fb4a008-f948-4246-aa0a-5f13577f6796 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:01:42.078857 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 1, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:01:42.079261 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Checking segment: {'id': 'c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 650, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:01:42.079757 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:42.080146 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Bound using segment: {'id': 'c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 650, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:01:42.080671 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Bound port: d48892bd-0ec5-49d9-8bf0-333fa7580d64, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 650, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:01:42.081039 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:42.171411 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] For port d48892bd-0ec5-49d9-8bf0-333fa7580d64, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:01:42.175356 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] For port d48892bd-0ec5-49d9-8bf0-333fa7580d64, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=d48892bd-0ec5-49d9-8bf0-333fa7580d64,segment=NetworkSegment(c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72),segment_id=c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:01:42.180083 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:42.185328 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:42.271430 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Pushing event updated for resources: {'Port': ['ID=d48892bd-0ec5-49d9-8bf0-333fa7580d64,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:42.274457 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:43.497081 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 55300) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:43.869280 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [None req-7c5771b3-0e8b-4cd4-8c44-1a9eb1bd6d24 admin admin] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119240) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:01:43.870258 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7c5771b3-0e8b-4cd4-8c44-1a9eb1bd6d24 admin admin] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3722456
Jun 01 11:01:46.201906 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 55310) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:46.579458 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [None req-5e3abd6b-f28b-4c17-a0fd-bbb3bf9314f6 admin admin] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119240) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:01:46.580514 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5e3abd6b-f28b-4c17-a0fd-bbb3bf9314f6 admin admin] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3776259
Jun 01 11:01:47.157868 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device d48892bd-0ec5-49d9-8bf0-333fa7580d64 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:01:47.237115 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port d48892bd-0ec5-49d9-8bf0-333fa7580d64 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:01:47.744737 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc301e2a-7281-4a0a-b85f-8512f00b513a None None] Network 3fb4a008-f948-4246-aa0a-5f13577f6796 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:01:47.845429 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-c25571ec-fca9-4156-9a7e-9e54a2bac275 None None] Provisioning for port d48892bd-0ec5-49d9-8bf0-333fa7580d64 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:01:47.865852 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-c25571ec-fca9-4156-9a7e-9e54a2bac275 None None] Provisioning complete for port d48892bd-0ec5-49d9-8bf0-333fa7580d64 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:01:47.866242 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c25571ec-fca9-4156-9a7e-9e54a2bac275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:48.098630 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c25571ec-fca9-4156-9a7e-9e54a2bac275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:48.147016 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-c25571ec-fca9-4156-9a7e-9e54a2bac275 None None] For port d48892bd-0ec5-49d9-8bf0-333fa7580d64, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=d48892bd-0ec5-49d9-8bf0-333fa7580d64,segment=NetworkSegment(c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72),segment_id=c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:01:48.154174 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c25571ec-fca9-4156-9a7e-9e54a2bac275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:48.171747 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:48.242759 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25571ec-fca9-4156-9a7e-9e54a2bac275 None None] Pushing event updated for resources: {'Port': ['ID=d48892bd-0ec5-49d9-8bf0-333fa7580d64,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:48.248058 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-c25571ec-fca9-4156-9a7e-9e54a2bac275 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:48.476137 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6c5bafa2-9aae-4950-997f-8f7dedca6091 None None] Provisioning complete for port d48892bd-0ec5-49d9-8bf0-333fa7580d64 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:01:48.476505 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6c5bafa2-9aae-4950-997f-8f7dedca6091 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:49.137345 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device d48892bd-0ec5-49d9-8bf0-333fa7580d64 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:01:49.208872 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port d48892bd-0ec5-49d9-8bf0-333fa7580d64 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:01:49.209572 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:49.242466 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 55328) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:49.593183 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Request body: {'router': {'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'name': 'router1', 'admin_state_up': True}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:01:49.598029 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:01:49.601745 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Usage tracker for resource:router and tenant:9568ccfdb70e43a3824aab31b740cc86 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:01:49.605674 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:01:49.611289 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:01:49.621475 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:49.623288 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:49.644887 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:49.768536 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:49.786089 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:49.787210 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-1892cb00-e763-4d9f-881d-91795f17e255 admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.5437827
Jun 01 11:01:52.113864 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 55338) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:52.475806 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [None req-815c6d92-d80f-4f7e-be77-8a68d95652c2 admin admin] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119240) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:01:52.476791 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-815c6d92-d80f-4f7e-be77-8a68d95652c2 admin admin] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3620095
Jun 01 11:01:52.656197 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-d4bc1049-4877-4065-976b-4d69e6a25e07 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:54.800604 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 55348) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:55.174311 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'router:external': True, 'name': 'public', 'admin_state_up': True, 'provider:physical_network': 'physnet1', 'is_default': True}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:01:55.179179 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:01:55.183648 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Usage tracker for resource:network and tenant:0ab5b7061b2845a6bacae9e08fe57368 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:01:55.186521 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:01:55.193172 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:01:55.202829 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Made reservation on behalf of 0ab5b7061b2845a6bacae9e08fe57368 for: {'network': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:01:55.203845 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ab0e0250-ab96-4c2a-90c4-302a6bae3903 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.205695 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.224681 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.239052 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:01:55.242871 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Usage tracker for resource:security_group_rule and tenant:0ab5b7061b2845a6bacae9e08fe57368 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:01:55.246721 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:01:55.252506 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:01:55.278018 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.344410 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.347950 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.351991 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:55.366347 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Reserving flat network on physical network physnet1 {{(pid=119240) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
Jun 01 11:01:55.387030 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d0769f7-bf9e-4f9c-b4cc-19ebc8867335,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:55.392643 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8750888656357', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.393215 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f5799c1de50> segment precommit_create {{(pid=119240) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 11:01:55.393669 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.segments_db [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Added segment abf878e1-d747-4b28-bf0b-78bc0965f02b of type flat for network 75238de6-1437-4113-aa89-3deeb50d4603
Jun 01 11:01:55.400529 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:55.439117 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.478436 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.480311 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:01:55.480861 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:55.485151 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:55.577013 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.7752914
Jun 01 11:01:55.579894 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Pushing event updated for resources: {'Network': ['ID=75238de6-1437-4113-aa89-3deeb50d4603,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:55.583142 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:55.594655 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 75238de6-1437-4113-aa89-3deeb50d4603 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:01:56.314790 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:57.651989 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:57.913407 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 55368) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:01:58.120800 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d78e7e21-a6bf-4a02-af0b-bbab1a5d9332 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:01:58.122109 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-d78e7e21-a6bf-4a02-af0b-bbab1a5d9332 admin admin] 10.222.0.74 "GET /v2.0/subnets/9a4bba74-ed05-4f1e-8b2a-c893d662d3dd HTTP/1.1" status: 200  len: 849 time: 0.2077618
Jun 01 11:01:58.265619 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-3d7347b3-dd57-4b2d-ab5b-7b14068be9a6 admin admin] 10.222.0.74 "GET /v2.0/routers/a17a66e9-a686-45fb-b728-a1b58d59caef HTTP/1.1" status: 200  len: 704 time: 0.1381590
Jun 01 11:01:58.719542 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:58.969311 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Allocated IP 172.20.0.1 (3fb4a008-f948-4246-aa0a-5f13577f6796/9a4bba74-ed05-4f1e-8b2a-c893d662d3dd/607ac89a-4b4a-46cf-b91c-123183d9397d) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:01:59.121333 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:59.138080 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Transition to ACTIVE for port object 607ac89a-4b4a-46cf-b91c-123183d9397d will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:01:59.191401 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:59.195857 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:59.257801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Network 3fb4a008-f948-4246-aa0a-5f13577f6796 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:01:59.260609 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:01:59.266500 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:01:59.267029 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:59.384481 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Pushing event updated for resources: {'Port': ['ID=607ac89a-4b4a-46cf-b91c-123183d9397d,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:59.398936 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:59.471029 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6e16cde9-72c8-4a04-82c2-963bd4e84c62 None None] Provisioning for port 607ac89a-4b4a-46cf-b91c-123183d9397d completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:01:59.475658 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6e16cde9-72c8-4a04-82c2-963bd4e84c62 None None] Provisioning complete for port 607ac89a-4b4a-46cf-b91c-123183d9397d triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:01:59.476110 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6e16cde9-72c8-4a04-82c2-963bd4e84c62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:59.523976 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:59.528146 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-6e16cde9-72c8-4a04-82c2-963bd4e84c62 None None] Port 607ac89a-4b4a-46cf-b91c-123183d9397d cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:01:59.749032 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:59.753313 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:59.754496 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:01:59.758376 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:01:59.888031 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Pushing event updated for resources: {'Port': ['ID=607ac89a-4b4a-46cf-b91c-123183d9397d,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:01:59.892668 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:01:59.949424 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Network 3fb4a008-f948-4246-aa0a-5f13577f6796 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:01:59.950477 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:02:00.135129 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Router a17a66e9-a686-45fb-b728-a1b58d59caef is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119240) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:02:00.150563 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-576db889-a501-4272-a5c4-cc598fff36c1 None None] Provisioning complete for port 607ac89a-4b4a-46cf-b91c-123183d9397d triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:02:00.150990 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-576db889-a501-4272-a5c4-cc598fff36c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:00.205618 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-576db889-a501-4272-a5c4-cc598fff36c1 None None] Port 607ac89a-4b4a-46cf-b91c-123183d9397d cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:02:00.325547 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:02:00.334791 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Sync routers for ids ['a17a66e9-a686-45fb-b728-a1b58d59caef'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:02:00.335274 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] 10.222.0.74 "PUT /v2.0/routers/a17a66e9-a686-45fb-b728-a1b58d59caef/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.0647953
Jun 01 11:02:00.345655 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Routers {'a17a66e9-a686-45fb-b728-a1b58d59caef'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:02:00.346505 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5799126ac0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:01:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a17a66e9-a686-45fb-b728-a1b58d59caef'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:02:00.524162 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Set router a17a66e9-a686-45fb-b728-a1b58d59caef gateway port host: None {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:02:00.885146 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5799126ac0>, [{'id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'name': 'router1', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:01:49Z', 'updated_at': '2021-06-01T11:01:59Z', 'revision_number': 2, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'gw_port_host': None, '_interfaces': [{'id': '607ac89a-4b4a-46cf-b91c-123183d9397d', 'name': '', 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'mac_address': 'fa:16:3e:bf:a7:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:01:58Z', 'updated_at': '2021-06-01T11:01:59Z', 'revision_number': 2, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'subnets': [{'id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '08f28881-8ca9-4663-8194-f35f5aee2850'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:02:00.890280 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Checking router: a17a66e9-a686-45fb-b728-a1b58d59caef for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:02:00.890651 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Updating router a17a66e9-a686-45fb-b728-a1b58d59caef port 607ac89a-4b4a-46cf-b91c-123183d9397d binding host dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:02:00.944768 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:01.318519 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Notify callbacks [] for port, precommit_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:01.333484 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.provisioning_blocks [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Transition to ACTIVE for port object 607ac89a-4b4a-46cf-b91c-123183d9397d will not be triggered until provisioned by entity L2. {{(pid=119243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:02:01.341577 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:01.347996 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:02:01.537208 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Pushing event updated for resources: {'Port': ['ID=607ac89a-4b4a-46cf-b91c-123183d9397d,revision_number=3']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:02:01.566891 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.567236 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.567567 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.567918 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.568238 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.568607 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.568874 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.569189 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.569517 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.569833 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.570140 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.570452 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Tracked resource versions report:
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]: pushed versions:
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]: {   'AddressGroup': {'1.2'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'ConntrackHelper': {'1.0'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Log': {'1.0'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Network': {'1.1'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Port': {'1.7'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'PortForwarding': {'1.2'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'QosPolicy': {'1.8'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'SecurityGroup': {'1.4'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'SecurityGroupRule': {'1.2'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'SubPort': {'1.0'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Subnet': {'1.1'},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Trunk': {'1.1'}}
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]: consumer versions:
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]: {   DHCP agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     L3 agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     Metadata agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     Metering agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:     Open vSwitch agent@dv-cinder-787764-3-iscsi: {   'AddressGroup': '1.2',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'ConntrackHelper': '1.0',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Log': '1.0',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Network': '1.1',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Port': '1.7',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'PortForwarding': '1.2',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'QosPolicy': '1.8',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'SecurityGroup': '1.4',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'SecurityGroupRule': '1.2',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'SubPort': '1.0',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Subnet': '1.1',
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Trunk': '1.1'}}
Jun 01 11:02:01.571535 dv-cinder-787764-3-iscsi neutron-server[119243]:  {{(pid=119243) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 11:02:01.577811 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:02:01.578546 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Attempting to bind port 607ac89a-4b4a-46cf-b91c-123183d9397d on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:02:01.578935 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Attempting to bind port 607ac89a-4b4a-46cf-b91c-123183d9397d by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 650, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796'}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:02:01.579364 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Attempting to bind port 607ac89a-4b4a-46cf-b91c-123183d9397d on network 3fb4a008-f948-4246-aa0a-5f13577f6796 {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:02:01.584601 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 1, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:02:01.585006 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Checking segment: {'id': 'c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 650, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:02:01.585463 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:01.585845 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Bound using segment: {'id': 'c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 650, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796'} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:02:01.586378 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Bound port: 607ac89a-4b4a-46cf-b91c-123183d9397d, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 650, 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796'}}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:02:01.586771 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:01.673063 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] For port 607ac89a-4b4a-46cf-b91c-123183d9397d, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:02:01.677109 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] For port 607ac89a-4b4a-46cf-b91c-123183d9397d, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=607ac89a-4b4a-46cf-b91c-123183d9397d,segment=NetworkSegment(c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72),segment_id=c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72)] {{(pid=119243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:02:01.681477 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:01.685661 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:02:01.771542 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Routers {'a17a66e9-a686-45fb-b728-a1b58d59caef'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:02:01.772190 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5799126ac0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:01:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a17a66e9-a686-45fb-b728-a1b58d59caef'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:02:01.827793 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Pushing event updated for resources: {'Port': ['ID=607ac89a-4b4a-46cf-b91c-123183d9397d,revision_number=4']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:02:01.837851 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:02:01.964348 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] Set router a17a66e9-a686-45fb-b728-a1b58d59caef gateway port host: None {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:02:02.288480 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5799126ac0>, [{'id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'name': 'router1', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:01:49Z', 'updated_at': '2021-06-01T11:01:59Z', 'revision_number': 2, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'gw_port_host': None, '_interfaces': [{'id': '607ac89a-4b4a-46cf-b91c-123183d9397d', 'name': '', 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'mac_address': 'fa:16:3e:bf:a7:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:01:58Z', 'updated_at': '2021-06-01T11:02:01Z', 'revision_number': 4, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'subnets': [{'id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '08f28881-8ca9-4663-8194-f35f5aee2850'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:02:02.292677 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd163051-3cb5-45e3-b1d0-bccc43c18d6d None None] The sync data for ids ['a17a66e9-a686-45fb-b728-a1b58d59caef'] in dv-cinder-787764-3-iscsi is: [{'id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'name': 'router1', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:01:49Z', 'updated_at': '2021-06-01T11:01:59Z', 'revision_number': 2, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'gw_port_host': None, '_interfaces': [{'id': '607ac89a-4b4a-46cf-b91c-123183d9397d', 'name': '', 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'mac_address': 'fa:16:3e:bf:a7:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:01:58Z', 'updated_at': '2021-06-01T11:02:01Z', 'revision_number': 4, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'subnets': [{'id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '08f28881-8ca9-4663-8194-f35f5aee2850'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:02:02.508094 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 55390) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:02:02.671455 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fed89bdd-101d-4675-bd58-ca58823f713b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:02:02.672943 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-fed89bdd-101d-4675-bd58-ca58823f713b admin admin] 10.222.0.74 "GET /v2.0/networks/75238de6-1437-4113-aa89-3deeb50d4603 HTTP/1.1" status: 200  len: 842 time: 0.1637633
Jun 01 11:02:02.683455 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Request body: {'subnet': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'name': 'public-subnet', 'ip_version': 4, 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'enable_dhcp': False}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:02:02.688244 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:02:02.692069 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Usage tracker for resource:subnet and tenant:0ab5b7061b2845a6bacae9e08fe57368 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:02:02.695029 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:02:02.701476 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:02:02.712298 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Made reservation on behalf of 0ab5b7061b2845a6bacae9e08fe57368 for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:02:02.715246 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Notify callbacks [] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:03.220645 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.objects.ports [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=119241) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
Jun 01 11:02:03.221134 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:03.225171 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:02:03.298676 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3393ce80-c770-4ca6-8844-f1f0c4351344,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:02:03.305944 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:02:03.306323 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Network hostable DHCP agents. Network: 75238de6-1437-4113-aa89-3deeb50d4603, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:02:03.310827 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:02:03.327752 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:02:03.339967 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 75238de6-1437-4113-aa89-3deeb50d4603) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:02:03.349315 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d000e01d-2266-4678-8d98-e7c12a8fdecb None None] Network 75238de6-1437-4113-aa89-3deeb50d4603 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:02:03.349821 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:02:03.350465 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:03.381326 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.7023771
Jun 01 11:02:03.556604 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-412adfc8-d50f-416d-b661-eac257a30043 None None] Network 75238de6-1437-4113-aa89-3deeb50d4603 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:02:03.812842 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 5 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:02:05.195921 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 607ac89a-4b4a-46cf-b91c-123183d9397d up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:02:05.266448 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 607ac89a-4b4a-46cf-b91c-123183d9397d completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:02:05.271015 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 607ac89a-4b4a-46cf-b91c-123183d9397d triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:02:05.271391 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:05.390632 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:05.421708 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 607ac89a-4b4a-46cf-b91c-123183d9397d, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=607ac89a-4b4a-46cf-b91c-123183d9397d,segment=NetworkSegment(c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72),segment_id=c56ba69c-ccd4-44ce-b8b4-b0cdd2c3ba72)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:02:05.425705 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:05.427847 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:02:05.496945 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=607ac89a-4b4a-46cf-b91c-123183d9397d,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:02:05.500298 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:02:05.611192 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 55404) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:02:05.833042 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-b000d564-3691-4c8a-af0e-e6a547d322e9 admin admin] 10.222.0.74 "GET /v2.0/routers/a17a66e9-a686-45fb-b728-a1b58d59caef HTTP/1.1" status: 200  len: 710 time: 0.2207072
Jun 01 11:02:05.960941 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f13608-e9fb-4140-be79-60e97804fba6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:02:05.962468 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-e3f13608-e9fb-4140-be79-60e97804fba6 admin admin] 10.222.0.74 "GET /v2.0/networks/75238de6-1437-4113-aa89-3deeb50d4603 HTTP/1.1" status: 200  len: 886 time: 0.1243255
Jun 01 11:02:05.971504 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:02:06.415910 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:06.765292 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:06.818991 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:06.954117 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Allocated IP 172.27.3.212 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/6b89d0f9-4249-4de8-9f3e-fefeb904785d) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:02:07.101467 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:07.152199 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 607ac89a-4b4a-46cf-b91c-123183d9397d up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:02:07.157878 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:07.162512 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:02:07.222364 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 607ac89a-4b4a-46cf-b91c-123183d9397d triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:02:07.222738 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:07.229236 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:02:07.232067 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:02:07.235465 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:02:07.296201 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Pushing event updated for resources: {'Port': ['ID=6b89d0f9-4249-4de8-9f3e-fefeb904785d,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:02:07.348274 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:02:07.614005 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:07.980687 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:07.983947 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-645166', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-645231', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-643323'] for router, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:08.157246 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Router a17a66e9-a686-45fb-b728-a1b58d59caef has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:02:08.335640 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:02:08.344496 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Sync routers for ids ['a17a66e9-a686-45fb-b728-a1b58d59caef'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:02:08.345551 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Notify callbacks [] for router, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:08.346752 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] 10.222.0.74 "PUT /v2.0/routers/a17a66e9-a686-45fb-b728-a1b58d59caef HTTP/1.1" status: 200  len: 890 time: 2.3783636
Jun 01 11:02:08.354333 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Routers {'a17a66e9-a686-45fb-b728-a1b58d59caef'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:02:08.354951 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57987d2e80>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:01:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a17a66e9-a686-45fb-b728-a1b58d59caef'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:02:08.548265 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Set router a17a66e9-a686-45fb-b728-a1b58d59caef gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:02:08.885001 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57987d2e80>, [{'id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'name': 'router1', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '6b89d0f9-4249-4de8-9f3e-fefeb904785d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:01:49Z', 'updated_at': '2021-06-01T11:02:07Z', 'revision_number': 4, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'gw_port': {'id': '6b89d0f9-4249-4de8-9f3e-fefeb904785d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:e6:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:02:06Z', 'updated_at': '2021-06-01T11:02:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '607ac89a-4b4a-46cf-b91c-123183d9397d', 'name': '', 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'mac_address': 'fa:16:3e:bf:a7:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:01:58Z', 'updated_at': '2021-06-01T11:02:05Z', 'revision_number': 5, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'subnets': [{'id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '08f28881-8ca9-4663-8194-f35f5aee2850'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:02:08.889974 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Checking router: a17a66e9-a686-45fb-b728-a1b58d59caef for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:02:08.890321 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Updating router a17a66e9-a686-45fb-b728-a1b58d59caef port 6b89d0f9-4249-4de8-9f3e-fefeb904785d binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:02:08.943739 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:09.269731 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:09.281239 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Transition to ACTIVE for port object 6b89d0f9-4249-4de8-9f3e-fefeb904785d will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:02:09.287752 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:09.291651 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-8dc949c3-3e2f-4e17-ab81-83656b34c3e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:02:09.371495 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Attempting to bind port 6b89d0f9-4249-4de8-9f3e-fefeb904785d on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:02:09.372176 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Attempting to bind port 6b89d0f9-4249-4de8-9f3e-fefeb904785d by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:02:09.372285 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Attempting to bind port 6b89d0f9-4249-4de8-9f3e-fefeb904785d on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:02:09.374176 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fedcc6f-fc7d-404a-9c19-0df4276032f4 None None] Pushing event updated for resources: {'Port': ['ID=6b89d0f9-4249-4de8-9f3e-fefeb904785d,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:02:09.377728 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9fedcc6f-fc7d-404a-9c19-0df4276032f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:02:09.380236 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 1, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:02:09.380614 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:02:09.381033 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:09.381397 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:02:09.381925 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Bound port: 6b89d0f9-4249-4de8-9f3e-fefeb904785d, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:02:09.382225 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:09.452294 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] For port 6b89d0f9-4249-4de8-9f3e-fefeb904785d, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:02:09.455244 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] For port 6b89d0f9-4249-4de8-9f3e-fefeb904785d, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=6b89d0f9-4249-4de8-9f3e-fefeb904785d,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:02:09.459869 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:09.464192 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9fedcc6f-fc7d-404a-9c19-0df4276032f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:02:09.539203 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Routers {'a17a66e9-a686-45fb-b728-a1b58d59caef'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:02:09.539758 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57987d2e80>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:01:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a17a66e9-a686-45fb-b728-a1b58d59caef'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:02:09.593482 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fedcc6f-fc7d-404a-9c19-0df4276032f4 None None] Pushing event updated for resources: {'Port': ['ID=6b89d0f9-4249-4de8-9f3e-fefeb904785d,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:02:09.602741 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9fedcc6f-fc7d-404a-9c19-0df4276032f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:02:09.721828 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] Set router a17a66e9-a686-45fb-b728-a1b58d59caef gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:02:10.069470 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57987d2e80>, [{'id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'name': 'router1', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '6b89d0f9-4249-4de8-9f3e-fefeb904785d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:01:49Z', 'updated_at': '2021-06-01T11:02:07Z', 'revision_number': 4, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'gw_port': {'id': '6b89d0f9-4249-4de8-9f3e-fefeb904785d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:e6:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:02:06Z', 'updated_at': '2021-06-01T11:02:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '607ac89a-4b4a-46cf-b91c-123183d9397d', 'name': '', 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'mac_address': 'fa:16:3e:bf:a7:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:01:58Z', 'updated_at': '2021-06-01T11:02:05Z', 'revision_number': 5, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'subnets': [{'id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '08f28881-8ca9-4663-8194-f35f5aee2850'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:02:10.073599 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e47fee2f-fa0d-44ad-b753-304bef9678f5 None None] The sync data for ids ['a17a66e9-a686-45fb-b728-a1b58d59caef'] in dv-cinder-787764-3-iscsi is: [{'id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'name': 'router1', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '6b89d0f9-4249-4de8-9f3e-fefeb904785d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:01:49Z', 'updated_at': '2021-06-01T11:02:07Z', 'revision_number': 4, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'gw_port': {'id': '6b89d0f9-4249-4de8-9f3e-fefeb904785d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:e6:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:02:06Z', 'updated_at': '2021-06-01T11:02:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '607ac89a-4b4a-46cf-b91c-123183d9397d', 'name': '', 'network_id': '3fb4a008-f948-4246-aa0a-5f13577f6796', 'tenant_id': '9568ccfdb70e43a3824aab31b740cc86', 'mac_address': 'fa:16:3e:bf:a7:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17a66e9-a686-45fb-b728-a1b58d59caef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:01:58Z', 'updated_at': '2021-06-01T11:02:05Z', 'revision_number': 5, 'project_id': '9568ccfdb70e43a3824aab31b740cc86', 'subnets': [{'id': '9a4bba74-ed05-4f1e-8b2a-c893d662d3dd', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '08f28881-8ca9-4663-8194-f35f5aee2850'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:02:10.701415 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 55414) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:02:10.817572 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-78b50c52-d732-45d6-b787-29ce4581a169 admin admin] 10.222.0.74 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 411 time: 0.1150303
Jun 01 11:02:11.182998 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 6b89d0f9-4249-4de8-9f3e-fefeb904785d up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:02:11.252195 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 6b89d0f9-4249-4de8-9f3e-fefeb904785d completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:02:11.257032 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 6b89d0f9-4249-4de8-9f3e-fefeb904785d triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:02:11.257415 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:11.376449 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:11.393391 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 6b89d0f9-4249-4de8-9f3e-fefeb904785d, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=6b89d0f9-4249-4de8-9f3e-fefeb904785d,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:02:11.397684 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:11.399840 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:02:11.468495 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=6b89d0f9-4249-4de8-9f3e-fefeb904785d,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:02:11.471465 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:02:13.164509 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 6b89d0f9-4249-4de8-9f3e-fefeb904785d up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:02:13.242784 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 6b89d0f9-4249-4de8-9f3e-fefeb904785d triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:02:13.243173 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:22.659546 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-97e3984c-0b92-40ad-a998-c43011d3f1fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:25.231171 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b4ae59b4-c348-483e-ae09-1bf862bc25d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:25.284137 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:26.319424 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:27.668399 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:40.813991 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 5 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:02:52.665188 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-97eccd13-7a9a-4725-a4f4-5eb6c16c7056 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:55.208178 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ce6d7dbf-f4fc-498b-b25c-7ebdaafd2174 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:55.281147 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:56.323064 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:02:57.672629 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:17.812257 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 5 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:03:22.667594 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-74f901b7-0dca-4dcd-8678-46aba6740a6d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:25.202690 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e7af3281-d75d-4921-95ab-3b10a13b87dc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:25.276470 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:26.324655 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:27.671956 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:45.921335 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 55984) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:03:45.987694 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.pecan_wsgi.hooks.translation [None req-c786fbf0-1bb5-4589-8e2c-a2581e07f70b admin admin] GET failed (client error): The resource could not be found.
Jun 01 11:03:45.989521 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c786fbf0-1bb5-4589-8e2c-a2581e07f70b admin admin] 10.222.0.74 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0672572
Jun 01 11:03:46.115455 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd396f25-e9c6-4755-9ccd-5376b8ec45ca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:03:46.116902 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-fd396f25-e9c6-4755-9ccd-5376b8ec45ca admin admin] 10.222.0.74 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1236479
Jun 01 11:03:48.192331 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 55994) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:03:48.300458 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c35f9c6-57a8-4c71-a72c-1d5475bf9a21 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:03:48.301558 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-6c35f9c6-57a8-4c71-a72c-1d5475bf9a21 admin admin] Synchronizing usage tracker for tenant:0ab5b7061b2845a6bacae9e08fe57368 on resource:subnet {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:03:48.318690 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-6c35f9c6-57a8-4c71-a72c-1d5475bf9a21 admin admin] Unset dirty status for tenant:0ab5b7061b2845a6bacae9e08fe57368 on resource:subnet {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:03:48.319910 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-6c35f9c6-57a8-4c71-a72c-1d5475bf9a21 admin admin] 10.222.0.74 "GET /v2.0/subnets/9a4bba74-ed05-4f1e-8b2a-c893d662d3dd HTTP/1.1" status: 200  len: 849 time: 0.1265957
Jun 01 11:03:48.329061 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:03:48.445294 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Notify callbacks [] for subnet, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:48.631021 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8750888646301'] for subnet, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:48.635745 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-998a9d7f-3fbb-475c-a3b7-c6d66f99a174 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:03:48.672879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:03:48.673842 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:48.679230 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] 10.222.0.74 "PUT /v2.0/subnets/9a4bba74-ed05-4f1e-8b2a-c893d662d3dd HTTP/1.1" status: 200  len: 868 time: 0.3494136
Jun 01 11:03:48.695528 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af38d2e4-cf92-42e7-9b47-ec3afdf8ba09 None None] Network 3fb4a008-f948-4246-aa0a-5f13577f6796 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:03:48.702688 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Pushing event updated for resources: {'Subnet': ['ID=9a4bba74-ed05-4f1e-8b2a-c893d662d3dd,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:03:48.710407 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.710772 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.711111 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.711451 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.711811 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.712162 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.712517 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.712854 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.713192 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.713513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.713830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.714144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:03:48.717714 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:03:49.181669 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6bea5cf9-3d0b-4317-9fd1-14c64bb0edb2 None None] Provisioning complete for port d48892bd-0ec5-49d9-8bf0-333fa7580d64 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:03:49.182201 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6bea5cf9-3d0b-4317-9fd1-14c64bb0edb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:49.310668 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6bea5cf9-3d0b-4317-9fd1-14c64bb0edb2 None None] Provisioning complete for port 607ac89a-4b4a-46cf-b91c-123183d9397d triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:03:49.310930 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6bea5cf9-3d0b-4317-9fd1-14c64bb0edb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:50.788737 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56004) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:03:50.958845 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8cd9db99-bb46-4861-9d1a-7db9a5bd6fdb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:03:50.959252 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8cd9db99-bb46-4861-9d1a-7db9a5bd6fdb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:03:50.960816 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-8cd9db99-bb46-4861-9d1a-7db9a5bd6fdb admin admin] 10.222.0.74 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1711078
Jun 01 11:03:52.669127 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0cf1138f-88b3-4b7e-aded-d2e2feefe3b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:53.084826 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56014) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:03:53.260636 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf2ba8bf-6964-4555-a2b2-7d43f52b9dc1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:03:53.261122 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf2ba8bf-6964-4555-a2b2-7d43f52b9dc1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:03:53.261842 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-bf2ba8bf-6964-4555-a2b2-7d43f52b9dc1 admin admin] Synchronizing usage tracker for tenant:0ab5b7061b2845a6bacae9e08fe57368 on resource:network {{(pid=119240) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:03:53.279985 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-bf2ba8bf-6964-4555-a2b2-7d43f52b9dc1 admin admin] Unset dirty status for tenant:0ab5b7061b2845a6bacae9e08fe57368 on resource:network {{(pid=119240) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:03:53.281145 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-bf2ba8bf-6964-4555-a2b2-7d43f52b9dc1 admin admin] 10.222.0.74 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1952970
Jun 01 11:03:54.811092 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 5 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:03:55.206593 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-3c5892a2-e212-4355-aa6c-c4119753fb82 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:55.270843 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:55.407473 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56024) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:03:55.582048 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-364278c1-9613-4ca8-aac2-95b85fa93b87 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:03:55.583378 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-364278c1-9613-4ca8-aac2-95b85fa93b87 admin admin] 10.222.0.74 "GET /v2.0/networks/3fb4a008-f948-4246-aa0a-5f13577f6796 HTTP/1.1" status: 200  len: 869 time: 0.1749516
Jun 01 11:03:56.328875 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:57.680988 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56034) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:03:57.682150 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:03:57.848251 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75cff705-9511-4a59-b0cc-58ef18ccdceb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:03:57.849627 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-75cff705-9511-4a59-b0cc-58ef18ccdceb admin admin] 10.222.0.74 "GET /v2.0/networks/75238de6-1437-4113-aa89-3deeb50d4603 HTTP/1.1" status: 200  len: 886 time: 0.1676114
Jun 01 11:03:59.921207 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56044) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:04:00.061346 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a4ed982-b868-4dd3-aa84-e33c016f2a99 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:00.061804 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a4ed982-b868-4dd3-aa84-e33c016f2a99 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:00.063283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-3a4ed982-b868-4dd3-aa84-e33c016f2a99 admin admin] 10.222.0.74 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1411481
Jun 01 11:04:02.171493 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56054) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:04:02.278988 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26132b64-b171-48ca-960c-fbd941243fc4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:02.279462 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26132b64-b171-48ca-960c-fbd941243fc4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:02.280975 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-26132b64-b171-48ca-960c-fbd941243fc4 admin admin] 10.222.0.74 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1085150
Jun 01 11:04:04.365950 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56064) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:04:04.466510 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed8c693a-0012-44de-a95a-121124d749c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:04.467876 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-ed8c693a-0012-44de-a95a-121124d749c0 admin admin] 10.222.0.74 "GET /v2.0/subnets/3393ce80-c770-4ca6-8844-f1f0c4351344 HTTP/1.1" status: 200  len: 816 time: 0.1009638
Jun 01 11:04:06.568305 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56074) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:04:06.677739 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5672f5c0-c7b7-41da-a2c6-940cdd1477f3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:06.679075 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-5672f5c0-c7b7-41da-a2c6-940cdd1477f3 admin admin] 10.222.0.74 "GET /v2.0/subnets/9a4bba74-ed05-4f1e-8b2a-c893d662d3dd HTTP/1.1" status: 200  len: 868 time: 0.1095457
Jun 01 11:04:22.669890 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-87ba7f83-fa5e-43bb-9129-7b6a160074ca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:25.210332 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-10ce8584-f928-4f0c-b8d5-5f00a775df31 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:25.273502 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:26.329183 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:27.686574 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:29.596037 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56118) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:04:29.649228 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [None req-53029c4b-57a3-4e3f-8082-799b198b3108 admin admin] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119241) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:04:29.649616 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-53029c4b-57a3-4e3f-8082-799b198b3108 admin admin] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0525894
Jun 01 11:04:31.810401 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 5 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:04:31.858170 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56128) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:04:31.924142 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.pecan_wsgi.hooks.translation [None req-c22fa36c-9021-4f48-87e8-426833c6a1c7 admin admin] GET failed (client error): The resource could not be found.
Jun 01 11:04:31.925430 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c22fa36c-9021-4f48-87e8-426833c6a1c7 admin admin] 10.222.0.74 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0662694
Jun 01 11:04:32.050112 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-991cc340-82fb-4b3b-8bd6-53f761256e1c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:32.051517 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-991cc340-82fb-4b3b-8bd6-53f761256e1c admin admin] 10.222.0.74 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1222541
Jun 01 11:04:34.171896 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56138) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:04:34.218196 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:04:34.224017 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:04:34.234644 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:04:34.243969 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Made reservation on behalf of 0ab5b7061b2845a6bacae9e08fe57368 for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:04:34.246222 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:34.334333 dv-cinder-787764-3-iscsi neutron-server[119241]: WARNING neutron.services.revisions.revision_plugin [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7f5793f94fd0] {project_id='0ab5b7061b2845a6bacae9e08fe57368', id='55b585cc-e6a7-48ab-b4de-2841a093c016', target_tenant='*', action='access_as_shared', object_id='fe2a4813-8fc4-470e-85ad-ebf66feddd76'}> to bump revision.
Jun 01 11:04:34.347096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 656}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:04:34.356543 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:34.356854 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Added segment bc859a66-f062-4775-9123-b19b13bb57b2 of type vlan for network fe2a4813-8fc4-470e-85ad-ebf66feddd76
Jun 01 11:04:34.381189 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:34.409967 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:34.411250 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:34.411835 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:34.415020 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:04:34.509437 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.3362076
Jun 01 11:04:34.512533 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Pushing event updated for resources: {'Network': ['ID=fe2a4813-8fc4-470e-85ad-ebf66feddd76,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:04:34.515395 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:04:34.524735 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network fe2a4813-8fc4-470e-85ad-ebf66feddd76 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:04:36.606558 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56148) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:04:36.676512 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.pecan_wsgi.hooks.translation [None req-c9e82767-f916-43cc-9a82-688603ee9472 admin admin] GET failed (client error): The resource could not be found.
Jun 01 11:04:36.677721 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-c9e82767-f916-43cc-9a82-688603ee9472 admin admin] 10.222.0.74 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0702269
Jun 01 11:04:36.782075 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e699d72-c7b0-4d76-ab91-8fc117e37808 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:36.784014 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-1e699d72-c7b0-4d76-ab91-8fc117e37808 admin admin] 10.222.0.74 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1018610
Jun 01 11:04:36.793561 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'description': 'shared-subnet', 'ip_version': 4, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:04:36.798290 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:04:36.808034 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:04:36.817698 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Made reservation on behalf of 0ab5b7061b2845a6bacae9e08fe57368 for: {'subnet': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:04:36.819900 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Notify callbacks [] for subnet, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:37.184244 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:37.188513 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:04:37.259018 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d6988831-43d9-492a-8338-66d5f373b3b8,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:04:37.270137 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.270507 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.270848 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.271180 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.271511 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.271882 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.272211 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.272551 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.272897 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.273221 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.273539 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.273860 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:37.278191 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:04:37.278982 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Checking segment: {'id': 'bc859a66-f062-4775-9123-b19b13bb57b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 656, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:04:37.279333 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Network hostable DHCP agents. Network: fe2a4813-8fc4-470e-85ad-ebf66feddd76, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119240) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:04:37.296168 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Network fe2a4813-8fc4-470e-85ad-ebf66feddd76 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119240) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:04:37.305021 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, fe2a4813-8fc4-470e-85ad-ebf66feddd76) {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:04:37.308868 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:04:37.309449 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:37.313492 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1a9df11-2908-4789-aba3-a018b275555f None None] Network fe2a4813-8fc4-470e-85ad-ebf66feddd76 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:04:37.334351 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.5440671
Jun 01 11:04:37.543496 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-fe2a4813-8fc4-470e-85ad-ebf66feddd76', 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76', 'tenant_id': '0ab5b7061b2845a6bacae9e08fe57368', 'fixed_ips': [{'subnet_id': 'd6988831-43d9-492a-8338-66d5f373b3b8'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:04:37.544344 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:37.710214 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Allocated IP 192.168.233.2 (fe2a4813-8fc4-470e-85ad-ebf66feddd76/d6988831-43d9-492a-8338-66d5f373b3b8/3cc240d1-8aa2-4600-805f-819162389e99) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:04:37.918816 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:37.929936 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Transition to ACTIVE for port object 3cc240d1-8aa2-4600-805f-819162389e99 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:04:37.948780 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Transition to ACTIVE for port object 3cc240d1-8aa2-4600-805f-819162389e99 will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:04:37.954647 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:37.959441 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:04:38.027088 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Network fe2a4813-8fc4-470e-85ad-ebf66feddd76 is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:04:38.029711 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:04:38.034967 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:04:38.037172 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Pushing event updated for resources: {'Port': ['ID=3cc240d1-8aa2-4600-805f-819162389e99,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:04:38.075416 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.075806 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.076144 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.076478 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.076807 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.077130 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.077447 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.077766 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.078100 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.078418 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.078743 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.079114 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:04:38.087923 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:04:38.144138 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Attempting to bind port 3cc240d1-8aa2-4600-805f-819162389e99 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:04:38.144507 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Attempting to bind port 3cc240d1-8aa2-4600-805f-819162389e99 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'bc859a66-f062-4775-9123-b19b13bb57b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 656, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:04:38.144871 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Attempting to bind port 3cc240d1-8aa2-4600-805f-819162389e99 on network fe2a4813-8fc4-470e-85ad-ebf66feddd76 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:04:38.150479 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 4, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:04:38.150849 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Checking segment: {'id': 'bc859a66-f062-4775-9123-b19b13bb57b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 656, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:04:38.151254 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:38.151668 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Bound using segment: {'id': 'bc859a66-f062-4775-9123-b19b13bb57b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 656, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:04:38.152142 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Bound port: 3cc240d1-8aa2-4600-805f-819162389e99, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc859a66-f062-4775-9123-b19b13bb57b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 656, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:04:38.152515 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:38.241437 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] For port 3cc240d1-8aa2-4600-805f-819162389e99, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:04:38.244904 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] For port 3cc240d1-8aa2-4600-805f-819162389e99, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=3cc240d1-8aa2-4600-805f-819162389e99,segment=NetworkSegment(bc859a66-f062-4775-9123-b19b13bb57b2),segment_id=bc859a66-f062-4775-9123-b19b13bb57b2)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:04:38.249377 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:38.253442 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:04:38.332187 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Pushing event updated for resources: {'Port': ['ID=3cc240d1-8aa2-4600-805f-819162389e99,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:04:38.340415 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:04:39.159696 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-660dd969-894f-47db-abd1-c56c2fc0d588 None None] Network fe2a4813-8fc4-470e-85ad-ebf66feddd76 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:04:39.246238 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6b7170e0-516a-4ca7-b718-e072a2c44771 None None] Provisioning for port 3cc240d1-8aa2-4600-805f-819162389e99 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:04:39.322943 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 3cc240d1-8aa2-4600-805f-819162389e99 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:04:39.461087 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 3cc240d1-8aa2-4600-805f-819162389e99 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:04:39.468540 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 3cc240d1-8aa2-4600-805f-819162389e99 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:04:39.468916 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:39.622086 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:39.657341 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 3cc240d1-8aa2-4600-805f-819162389e99, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=3cc240d1-8aa2-4600-805f-819162389e99,segment=NetworkSegment(bc859a66-f062-4775-9123-b19b13bb57b2),segment_id=bc859a66-f062-4775-9123-b19b13bb57b2)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:04:39.665566 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:39.668949 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:04:39.734926 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-e3250383-dde7-4c2b-9fad-3160390bcf33 None None] Provisioning complete for port 3cc240d1-8aa2-4600-805f-819162389e99 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:04:39.735403 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e3250383-dde7-4c2b-9fad-3160390bcf33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:39.791222 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=3cc240d1-8aa2-4600-805f-819162389e99,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:04:39.794593 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:04:41.274263 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 3cc240d1-8aa2-4600-805f-819162389e99 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:04:41.340730 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 3cc240d1-8aa2-4600-805f-819162389e99 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:04:41.341098 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:52.672058 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-fddecd8b-44a1-4ba9-ae49-93b88d5799e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:55.212938 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-33e7f987-c1d6-422e-9a97-c17cf2300f54 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:55.277316 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:56.332950 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:04:57.687361 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:08.808974 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 5 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:05:22.673949 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e60e0dc2-ddfe-4939-9789-8ce3942452d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:25.213347 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-1ba4e111-bad0-45c0-86c0-4b4c652ee4b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:25.278944 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:26.336579 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:27.694937 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:43.847919 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56198) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:05:43.853961 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [None req-499d0a0c-f3ac-4ffc-89d1-9f2c043a14ef tempest-verify_tempest_config-1666503694 tempest-verify_tempest_config-1666503694-project] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119240) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:05:43.854900 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-499d0a0c-f3ac-4ffc-89d1-9f2c043a14ef tempest-verify_tempest_config-1666503694 tempest-verify_tempest_config-1666503694-project] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0060422
Jun 01 11:05:44.159801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56216) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:05:44.274379 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:44.288649 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:05:44.292344 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Usage tracker for resource:security_group_rule and tenant:753f740ea5b247cf8e1a290fb2c52868 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:05:44.295113 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:05:44.301313 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:05:44.379556 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:44.386946 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:44.395046 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:05:44.435439 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b54602ee-f933-4e6b-89e9-1c0a1baf6319,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:05:44.438358 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Synchronizing usage tracker for tenant:0ab5b7061b2845a6bacae9e08fe57368 on resource:security_group {{(pid=119240) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:05:44.448769 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.449128 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.449467 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.449797 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.450122 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.450446 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.450763 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.451095 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.451431 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.451790 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.452598 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.452910 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:05:44.457613 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:05:44.465831 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Unset dirty status for tenant:0ab5b7061b2845a6bacae9e08fe57368 on resource:security_group {{(pid=119240) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:05:44.467382 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=753f740ea5b247cf8e1a290fb2c52868&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3066201
Jun 01 11:05:44.470575 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56222) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:05:44.526879 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-24faff88-e498-45ce-8fbd-f9670200cda1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:44.551606 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-24faff88-e498-45ce-8fbd-f9670200cda1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:44.642519 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-24faff88-e498-45ce-8fbd-f9670200cda1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:44.646341 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:05:44.660322 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24faff88-e498-45ce-8fbd-f9670200cda1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b54602ee-f933-4e6b-89e9-1c0a1baf6319,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:05:44.663114 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-24faff88-e498-45ce-8fbd-f9670200cda1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:05:44.665127 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-24faff88-e498-45ce-8fbd-f9670200cda1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:44.667690 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-24faff88-e498-45ce-8fbd-f9670200cda1 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/b54602ee-f933-4e6b-89e9-1c0a1baf6319 HTTP/1.1" status: 204  len: 168 time: 0.1947203
Jun 01 11:05:45.807147 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 5 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:05:52.676437 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-54ca19b8-2950-40f7-9af1-14ddb5671896 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:55.215273 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e50fe5b9-a2af-440f-81de-e7f3c0fb78c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:55.280991 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:56.338146 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:05:57.695713 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:22.678344 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0bf44f60-a6dc-4bc3-b60b-d21d6cdc7009 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:22.806162 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 5 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:06:25.217019 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-644ce196-a5ea-4fad-81d7-4f2c2ea1ee9a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:25.284858 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:26.345280 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:27.699599 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:52.678642 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c2bcef48-6ed0-4df7-9a8c-202dd84ad3c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:55.220193 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a5a0de8a-1866-4dcc-8678-20bb5478b631 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:55.288474 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:56.344459 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:57.702895 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:06:59.804519 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 5 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:07:15.249942 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366'] for agent, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:18.926576 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56274) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:07:19.037744 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c896243b-ec32-455d-a072-9113d7cafb74 admin admin] 10.222.0.74 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1100845
Jun 01 11:07:21.168385 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56284) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:07:21.222592 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-5c535dee-8df8-408a-ac4a-5ab9ba0a9edb admin admin] 10.222.0.74 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0531547
Jun 01 11:07:22.681547 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-4217756d-9ac4-4a15-aa49-6eb8439547ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:25.222684 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-3512b0f7-74d2-4c35-9687-235fe83c9aa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:25.289369 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:26.347131 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:27.705864 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:36.803966 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:07:45.206596 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:52.683603 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8691c947-d74d-4aa4-adf7-8fc4878859b2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:55.224183 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-357ab65f-1946-4273-8485-b78a70f7ae06 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:55.290675 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:56.351725 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:07:57.708558 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:13.802603 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:08:15.215839 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:22.684306 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-354895d2-617e-45be-8fd9-843a22eae14e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:25.226509 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b40a9c7c-a840-4c8a-981a-53e1998281c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:25.291821 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:26.353781 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:27.711830 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:44.257009 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56382) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:44.448350 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-407322815-network', 'tenant_id': '0575695b945b453b9737182f6235cbe5'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:44.453981 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:44.458772 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Usage tracker for resource:network and tenant:0575695b945b453b9737182f6235cbe5 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:44.461923 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:44.467997 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:44.485370 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Made reservation on behalf of 0575695b945b453b9737182f6235cbe5 for: {'network': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:44.488295 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:44.502002 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:44.519702 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:44.523919 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Usage tracker for resource:security_group_rule and tenant:0575695b945b453b9737182f6235cbe5 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:44.526882 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:44.533384 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:44.631574 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:44.638485 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:44.644784 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:44.677671 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 660}  {{(pid=119240) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:08:44.682770 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1074cba-4e35-4346-aa70-e3bc340cdc99,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:44.691380 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.691779 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.692121 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.692449 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.692773 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.693125 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.693452 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.693802 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.694131 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.694448 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.694760 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.695168 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Tracked resource versions report:
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]: pushed versions:
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]: {   'AddressGroup': {'1.2'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'ConntrackHelper': {'1.0'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Log': {'1.0'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Network': {'1.1'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Port': {'1.7'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'PortForwarding': {'1.2'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'QosPolicy': {'1.8'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'SecurityGroup': {'1.4'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'SecurityGroupRule': {'1.2'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'SubPort': {'1.0'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Subnet': {'1.1'},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     'Trunk': {'1.1'}}
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]: consumer versions:
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]: {   DHCP agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     HyperV agent@hv-cinder-78776: {},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     L3 agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     Metadata agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     Metering agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:     Open vSwitch agent@dv-cinder-787764-3-iscsi: {   'AddressGroup': '1.2',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'ConntrackHelper': '1.0',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Log': '1.0',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Network': '1.1',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Port': '1.7',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'PortForwarding': '1.2',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'QosPolicy': '1.8',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'SecurityGroup': '1.4',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'SecurityGroupRule': '1.2',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'SubPort': '1.0',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Subnet': '1.1',
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:                                                      'Trunk': '1.1'}}
Jun 01 11:08:44.696202 dv-cinder-787764-3-iscsi neutron-server[119240]:  {{(pid=119240) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 11:08:44.702221 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:44.707025 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:44.708249 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.segments_db [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Added segment 989f88ce-9ed9-4d44-aabd-f14b3be6c3d4 of type vlan for network 16003d7c-7204-44bb-9e84-543e6390b879
Jun 01 11:08:44.735414 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:44.769912 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:44.771219 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:44.771826 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:44.781231 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:44.878824 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.6177261
Jun 01 11:08:44.879214 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56436) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:44.883338 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Pushing event updated for resources: {'Network': ['ID=16003d7c-7204-44bb-9e84-543e6390b879,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:44.885230 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Request body: {'subnet': {'network_id': '16003d7c-7204-44bb-9e84-543e6390b879', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-407322815-subnet', 'tenant_id': '0575695b945b453b9737182f6235cbe5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:44.886738 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:44.891049 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:44.897203 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 16003d7c-7204-44bb-9e84-543e6390b879 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:08:44.905979 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Usage tracker for resource:subnet and tenant:0575695b945b453b9737182f6235cbe5 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:44.915457 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:44.921532 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:44.934295 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Made reservation on behalf of 0575695b945b453b9737182f6235cbe5 for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:44.938667 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Notify callbacks [] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:45.233347 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:45.344820 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:45.349600 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b9022cf1-1be9-491f-8ace-c9eadcf6524c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:45.408455 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Pushing event updated for resources: {'Subnet': ['ID=4244194d-2962-4661-95dd-d3f879a92c43,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:45.416484 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.416856 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.417193 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.417519 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.417841 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.418176 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.418499 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.418832 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.419148 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.419459 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.419799 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.420115 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Tracked resource versions report:
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]: pushed versions:
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]: {   'AddressGroup': {'1.2'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'ConntrackHelper': {'1.0'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Log': {'1.0'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Network': {'1.1'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Port': {'1.7'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'PortForwarding': {'1.2'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'QosPolicy': {'1.8'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'SecurityGroup': {'1.4'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'SecurityGroupRule': {'1.2'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'SubPort': {'1.0'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Subnet': {'1.1'},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     'Trunk': {'1.1'}}
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]: consumer versions:
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]: {   DHCP agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     HyperV agent@hv-cinder-78776: {},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     L3 agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     Metadata agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     Metering agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:     Open vSwitch agent@dv-cinder-787764-3-iscsi: {   'AddressGroup': '1.2',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'ConntrackHelper': '1.0',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Log': '1.0',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Network': '1.1',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Port': '1.7',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'PortForwarding': '1.2',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'QosPolicy': '1.8',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'SecurityGroup': '1.4',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'SecurityGroupRule': '1.2',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'SubPort': '1.0',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Subnet': '1.1',
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:                                                      'Trunk': '1.1'}}
Jun 01 11:08:45.421124 dv-cinder-787764-3-iscsi neutron-server[119241]:  {{(pid=119241) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 11:08:45.429105 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:45.448991 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Checking segment: {'id': '989f88ce-9ed9-4d44-aabd-f14b3be6c3d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 660, 'network_id': '16003d7c-7204-44bb-9e84-543e6390b879'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:08:45.449260 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Network hostable DHCP agents. Network: 16003d7c-7204-44bb-9e84-543e6390b879, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:08:45.468147 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Network 16003d7c-7204-44bb-9e84-543e6390b879 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:08:45.479513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 16003d7c-7204-44bb-9e84-543e6390b879) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:45.491713 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:45.492203 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43fb85c5-eb12-4cad-8b05-2eb58e550ea4 None None] Network 16003d7c-7204-44bb-9e84-543e6390b879 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:08:45.492592 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:45.524282 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 0.6438904
Jun 01 11:08:45.744995 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1881346a-14bc-45d4-918f-2db9ad6bbb61 None None] Network 16003d7c-7204-44bb-9e84-543e6390b879 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:08:46.344753 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56516) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:46.377317 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56522) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:46.414622 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56530) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:46.761075 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-328178639-network', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:46.765488 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:46.769499 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Usage tracker for resource:network and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:46.773667 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:46.780536 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:46.793214 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Made reservation on behalf of c004520781bb4854b87284b73cc2a8be for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:46.798041 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:46.817429 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:46.836096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-959695017-network', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:46.842404 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:46.847022 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Usage tracker for resource:security_group_rule and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:46.850581 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:46.857024 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:46.863155 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Usage tracker for resource:network and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:46.866880 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:46.872916 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:46.883203 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-802073209-network', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:46.889875 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:46.906836 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:46.910526 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Made reservation on behalf of 22a029b4c9f84f4191259891ac3af6c3 for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:46.913186 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:46.932803 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Usage tracker for resource:network and tenant:aac1cb46a9b144f5a5fac5f5c98fed2b is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:46.936091 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:46.951242 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:46.953256 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:46.993687 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:47.003397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Made reservation on behalf of aac1cb46a9b144f5a5fac5f5c98fed2b for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:47.005680 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.018180 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Usage tracker for resource:security_group_rule and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:47.026236 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:47.029987 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.050186 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:47.060153 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:47.079275 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Usage tracker for resource:security_group_rule and tenant:aac1cb46a9b144f5a5fac5f5c98fed2b is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:47.090986 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:47.102744 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:47.152356 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.175638 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.189341 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:47.228473 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8a704f7-e3f1-4215-ac51-d3a0e86c39f4,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:47.261456 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:47.283276 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 687}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:08:47.314039 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.314696 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Added segment 218ec5cc-bc49-4575-bae0-d28b11abe976 of type vlan for network ce8e721a-c529-4460-882f-9261a0c7ceed
Jun 01 11:08:47.418660 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.467745 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.531846 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.554086 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.594876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:47.611096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 695}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:08:47.614025 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:47.615142 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.667542 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.667929 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Added segment f42fc69f-20da-4605-91d9-46f05e1a6b0a of type vlan for network 418faffe-faca-4025-ab0f-56771435263e
Jun 01 11:08:47.695353 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c081aed-861d-474e-ac3b-be9b71026d8d,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:47.701233 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.703286 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:47.706048 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-bdf09e2b-71ae-45c3-b80d-dec2348c9ab8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.079s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:47.735962 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:47.846940 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:48.034117 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56596) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:48.043677 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Request body: {'subnet': {'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-subnet', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:48.044658 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 1.6985991
Jun 01 11:08:48.049064 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Pushing event updated for resources: {'Network': ['ID=ce8e721a-c529-4460-882f-9261a0c7ceed,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:48.054211 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.348s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:48.059329 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:48.060913 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network ce8e721a-c529-4460-882f-9261a0c7ceed details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:08:48.065051 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fb13e4ea-1c5b-4db3-ba18-76b0a435ca06 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.167s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:48.076965 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Usage tracker for resource:subnet and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:48.082333 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:48.125232 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:48.179803 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Made reservation on behalf of c004520781bb4854b87284b73cc2a8be for: {'subnet': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:48.187102 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Notify callbacks [] for subnet, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:48.208068 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:48.209340 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 693}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:08:48.212893 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92b41362-5e38-456f-a9ce-05c3b0c3b3ad,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:48.235412 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:48.240790 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:48.298513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:48.303783 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:48.581494 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Pushing event updated for resources: {'Network': ['ID=418faffe-faca-4025-ab0f-56771435263e,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:48.589294 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 2.1694660
Jun 01 11:08:48.589294 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:48.590916 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56624) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:48.601425 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Request body: {'subnet': {'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-959695017-subnet', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:48.603508 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 418faffe-faca-4025-ab0f-56771435263e details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:08:48.609447 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:48.616948 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Usage tracker for resource:subnet and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:48.622903 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:48.636449 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:48.650517 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:48.651286 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Added segment 282c4d7b-9de4-4e04-b767-7c3bddb71626 of type vlan for network e8c7dea7-722b-446b-9e9f-d27643e48187
Jun 01 11:08:48.662202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Made reservation on behalf of 22a029b4c9f84f4191259891ac3af6c3 for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:48.667851 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Notify callbacks [] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:48.835254 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56632) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:48.848280 dv-cinder-787764-3-iscsi neutron-server[119241]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 01 11:08:48.997968 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56644) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:49.071534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.107053 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.113679 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:49.195401 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Pushing event updated for resources: {'Subnet': ['ID=79a8ddfd-a675-47e5-9921-33f71f58d781,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:49.199640 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:49.222375 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.226722 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:49.227286 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.229357 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.234479 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:49.246822 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Checking segment: {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:08:49.247183 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Network hostable DHCP agents. Network: ce8e721a-c529-4460-882f-9261a0c7ceed, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119240) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:08:49.257003 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:49.262094 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0f524851-e990-416d-b239-1bb7945ad498 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:49.263677 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0f524851-e990-416d-b239-1bb7945ad498 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/networks?id=16003d7c-7204-44bb-9e84-543e6390b879 HTTP/1.1" status: 200  len: 811 time: 0.4211957
Jun 01 11:08:49.265118 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Usage tracker for resource:security_group_rule and tenant:55d719a41e3540ddbc20970afc5b1329 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:49.268837 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:49.285430 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:49.298903 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Network ce8e721a-c529-4460-882f-9261a0c7ceed is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119240) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:08:49.320842 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, ce8e721a-c529-4460-882f-9261a0c7ceed) {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:49.326393 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:49.328325 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.334624 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61059f6b-3b86-4834-8a95-5bbd7c0dbdff None None] Network ce8e721a-c529-4460-882f-9261a0c7ceed requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:08:49.349409 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 891 time: 2.9651821
Jun 01 11:08:49.354066 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56664) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:49.358098 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-f34c919d-faba-4106-ae69-cbaf70925edc tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/quotas/0575695b945b453b9737182f6235cbe5 HTTP/1.1" status: 200  len: 375 time: 0.0815935
Jun 01 11:08:49.368239 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Request body: {'subnet': {'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-subnet', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:49.377310 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 1.3410153
Jun 01 11:08:49.380648 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56668) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:49.386454 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:49.387894 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:49.390075 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Pushing event updated for resources: {'Network': ['ID=e8c7dea7-722b-446b-9e9f-d27643e48187,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:49.400760 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:49.412640 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Usage tracker for resource:router and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:49.423472 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:49.424953 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:49.431501 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Usage tracker for resource:subnet and tenant:aac1cb46a9b144f5a5fac5f5c98fed2b is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:49.436105 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:49.436573 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:49.442392 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network e8c7dea7-722b-446b-9e9f-d27643e48187 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:08:49.453454 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:49.457520 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-164f34f0-8f6b-45f9-a350-96ea1fe8404b tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=0575695b945b453b9737182f6235cbe5&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0858235
Jun 01 11:08:49.476704 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.484592 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.497982 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8c4ab566-df53-4557-b58a-43c1036e6357 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:49.527118 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Made reservation on behalf of aac1cb46a9b144f5a5fac5f5c98fed2b for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:49.529433 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Notify callbacks [] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.534902 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ddf5d149-a6b0-407c-8066-3b017cd603eb,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:49.539702 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:49.540882 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.543249 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.569348 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.678926 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.690466 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:49.787380 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Pushing event updated for resources: {'Subnet': ['ID=08c4a15d-0d06-4d4b-909f-10ac28c5c16c,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:49.794895 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:49.795717 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56688) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:49.811703 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Checking segment: {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:08:49.812521 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Network hostable DHCP agents. Network: 418faffe-faca-4025-ab0f-56771435263e, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:08:49.864802 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-c8656cba-d166-446f-9fc8-9ff884d68016 service neutron] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119241) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:08:49.866014 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-c8656cba-d166-446f-9fc8-9ff884d68016 service neutron] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1177199
Jun 01 11:08:49.879253 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=55d719a41e3540ddbc20970afc5b1329&name=default HTTP/1.1" status: 200  len: 2975 time: 0.8787076
Jun 01 11:08:49.890195 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56694) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:49.925768 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-ce8e721a-c529-4460-882f-9261a0c7ceed', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:08:49.926611 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:49.944762 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.031948 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:50.031948 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Network 418faffe-faca-4025-ab0f-56771435263e is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:08:50.047310 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Usage tracker for resource:security_group_rule and tenant:91abc136691d488bb2f4a9b40d34f2d4 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:50.052783 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:50.064483 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.075023 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:50.088085 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 418faffe-faca-4025-ab0f-56771435263e) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:50.116753 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Allocated IP 172.20.0.2 (ce8e721a-c529-4460-882f-9261a0c7ceed/79a8ddfd-a675-47e5-9921-33f71f58d781/df5a5bab-5537-41fd-af8f-50c6c78af549) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:08:50.117258 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:50.117721 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.182256 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-58decca6-8546-442d-8f5d-07400688f24b service neutron] 10.222.0.74 "GET /v2.0/networks/16003d7c-7204-44bb-9e84-543e6390b879?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2981350
Jun 01 11:08:50.226231 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.6307774
Jun 01 11:08:50.238762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56706) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:50.240286 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7ce37959-658f-4f1e-bea2-cf642f59f5be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.265685 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae5321bf-6796-4d4e-970f-5ba67a90fec3 None None] Network 418faffe-faca-4025-ab0f-56771435263e requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:08:50.288688 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:50.330775 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:50.359693 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Usage tracker for resource:router and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:50.366761 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:50.371377 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7ce37959-658f-4f1e-bea2-cf642f59f5be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.390951 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:50.434850 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.435975 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.489204 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.508739 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-3bc4b3de-f439-4b09-a7ca-a81a0b758d63 service neutron] 10.222.0.74 "GET /v2.0/networks/16003d7c-7204-44bb-9e84-543e6390b879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3198826
Jun 01 11:08:50.513891 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.536682 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.552392 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:50.557301 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.605445 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=91abc136691d488bb2f4a9b40d34f2d4&name=default HTTP/1.1" status: 200  len: 2975 time: 0.8057792
Jun 01 11:08:50.609723 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56720) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:50.615498 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd62e3d4-b3c0-46a7-bab8-a9ba01f761e2,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:50.656978 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:50.708976 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7ce37959-658f-4f1e-bea2-cf642f59f5be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.711610 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Transition to ACTIVE for port object df5a5bab-5537-41fd-af8f-50c6c78af549 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:08:50.742535 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Transition to ACTIVE for port object df5a5bab-5537-41fd-af8f-50c6c78af549 will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:08:50.760096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.770730 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.775243 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a55bdc06-a3e5-45be-9ad8-9d01f68e414c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:50.803861 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:08:50.816809 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-24faff88-e498-45ce-8fbd-f9670200cda1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:50.844423 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-c25571ec-fca9-4156-9a7e-9e54a2bac275 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:50.850597 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0cb53050-3fd8-4f35-9dce-843b516da9d6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:50.920667 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56740) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:50.937293 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Network ce8e721a-c529-4460-882f-9261a0c7ceed is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:08:50.984660 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:51.003713 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:08:51.064921 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Pushing event updated for resources: {'Port': ['ID=df5a5bab-5537-41fd-af8f-50c6c78af549,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:51.087328 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.087729 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.088068 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.088397 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.088721 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.089041 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.089357 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.089674 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.090009 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.090321 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.090770 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.091322 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Tracked resource versions report:
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]: pushed versions:
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]: {   'AddressGroup': {'1.2'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'ConntrackHelper': {'1.0'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Log': {'1.0'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Network': {'1.1'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Port': {'1.7'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'PortForwarding': {'1.2'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'QosPolicy': {'1.8'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'SecurityGroup': {'1.4'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'SecurityGroupRule': {'1.2'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'SubPort': {'1.0'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Subnet': {'1.1'},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     'Trunk': {'1.1'}}
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]: consumer versions:
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]: {   DHCP agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     HyperV agent@hv-cinder-78776: {},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     L3 agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     Metadata agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     Metering agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:     Open vSwitch agent@dv-cinder-787764-3-iscsi: {   'AddressGroup': '1.2',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'ConntrackHelper': '1.0',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Log': '1.0',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Network': '1.1',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Port': '1.7',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'PortForwarding': '1.2',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'QosPolicy': '1.8',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'SecurityGroup': '1.4',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'SecurityGroupRule': '1.2',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'SubPort': '1.0',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Subnet': '1.1',
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:                                                      'Trunk': '1.1'}}
Jun 01 11:08:51.092617 dv-cinder-787764-3-iscsi neutron-server[119242]:  {{(pid=119242) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 11:08:51.104557 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:51.112943 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0cb53050-3fd8-4f35-9dce-843b516da9d6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.119520 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:51.131566 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-549d3d9f-e5ca-47f7-bcef-3b05a362069e req-16d44075-6542-4791-87a7-daa0e8d740dc tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.2044017
Jun 01 11:08:51.132380 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.357s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:51.180088 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Checking segment: {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:08:51.180657 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Network hostable DHCP agents. Network: e8c7dea7-722b-446b-9e9f-d27643e48187, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:08:51.217387 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Network e8c7dea7-722b-446b-9e9f-d27643e48187 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:08:51.221048 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Attempting to bind port df5a5bab-5537-41fd-af8f-50c6c78af549 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:08:51.221503 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Attempting to bind port df5a5bab-5537-41fd-af8f-50c6c78af549 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:08:51.222344 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Attempting to bind port df5a5bab-5537-41fd-af8f-50c6c78af549 on network ce8e721a-c529-4460-882f-9261a0c7ceed {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:08:51.230981 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 8, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:08:51.231459 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Checking segment: {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:08:51.231972 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.232443 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Bound using segment: {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:08:51.233007 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Bound port: df5a5bab-5537-41fd-af8f-50c6c78af549, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:08:51.233460 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.233932 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ce37959-658f-4f1e-bea2-cf642f59f5be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ddf5d149-a6b0-407c-8066-3b017cd603eb,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:51.240928 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7ce37959-658f-4f1e-bea2-cf642f59f5be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.424s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:51.249342 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-418faffe-faca-4025-ab0f-56771435263e', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:08:51.250308 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.250732 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, e8c7dea7-722b-446b-9e9f-d27643e48187) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:51.254396 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0cb53050-3fd8-4f35-9dce-843b516da9d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.256394 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:51.257198 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.273063 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecd027a7-3386-4644-858e-1effa3ec8f34 None None] Network e8c7dea7-722b-446b-9e9f-d27643e48187 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:08:51.274938 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4e788ee2-9a87-4acc-9f7a-8306300bf8b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:51.293771 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0cb53050-3fd8-4f35-9dce-843b516da9d6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.295387 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0cb53050-3fd8-4f35-9dce-843b516da9d6 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/bd62e3d4-b3c0-46a7-bab8-a9ba01f761e2 HTTP/1.1" status: 204  len: 168 time: 0.6829927
Jun 01 11:08:51.296951 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb53050-3fd8-4f35-9dce-843b516da9d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd62e3d4-b3c0-46a7-bab8-a9ba01f761e2,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:51.313330 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0cb53050-3fd8-4f35-9dce-843b516da9d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:51.319618 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 855 time: 1.9559407
Jun 01 11:08:51.319937 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56752) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:51.321760 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7ce37959-658f-4f1e-bea2-cf642f59f5be admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.325025 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7ce37959-658f-4f1e-bea2-cf642f59f5be admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/ddf5d149-a6b0-407c-8066-3b017cd603eb HTTP/1.1" status: 204  len: 168 time: 1.4311907
Jun 01 11:08:51.330588 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:51.336230 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:51.342788 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Usage tracker for resource:router and tenant:aac1cb46a9b144f5a5fac5f5c98fed2b is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:51.349566 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:51.358455 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:51.384794 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.391322 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.392519 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.412476 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.455433 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.585652 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.653114 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Allocated IP 172.20.0.2 (418faffe-faca-4025-ab0f-56771435263e/08c4a15d-0d06-4d4b-909f-10ac28c5c16c/27b19c3f-289e-417b-a07e-63b061c293a3) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:08:51.828539 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Allocated IP 172.27.3.46 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/361ec9aa-775c-4942-9aac-a9385710054a) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:08:51.862195 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:51.936357 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56780) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:51.937251 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56782) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:52.048267 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f94ef0b9-1df8-45d0-9548-9412be4c46c5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.052708 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] For port df5a5bab-5537-41fd-af8f-50c6c78af549, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:08:52.072935 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.080306 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] For port df5a5bab-5537-41fd-af8f-50c6c78af549, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=df5a5bab-5537-41fd-af8f-50c6c78af549,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:08:52.089883 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.102840 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.112544 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:52.124296 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f94ef0b9-1df8-45d0-9548-9412be4c46c5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:52.135226 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f94ef0b9-1df8-45d0-9548-9412be4c46c5 admin admin] Usage tracker for resource:security_group_rule and tenant:795b193986604f389e00476cd6b18352 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:52.144090 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f94ef0b9-1df8-45d0-9548-9412be4c46c5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:52.155072 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f94ef0b9-1df8-45d0-9548-9412be4c46c5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:52.185936 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.256754 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.301592 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.305313 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Transition to ACTIVE for port object 27b19c3f-289e-417b-a07e-63b061c293a3 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:08:52.322667 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6446d4d3-6350-4bf3-b2b3-20dcc09b8680 None None] Network e8c7dea7-722b-446b-9e9f-d27643e48187 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:08:52.411357 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f94ef0b9-1df8-45d0-9548-9412be4c46c5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.427894 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.452130 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:52.522434 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:52.530591 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Usage tracker for resource:security_group_rule and tenant:10822f465ef346a8afad5b03e0f36aec is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:52.537235 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:52.540273 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56810) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:52.544544 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:52.553903 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Pushing event updated for resources: {'Port': ['ID=df5a5bab-5537-41fd-af8f-50c6c78af549,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:52.574937 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Transition to ACTIVE for port object 27b19c3f-289e-417b-a07e-63b061c293a3 will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:08:52.576319 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.464s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:52.607887 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Pushing event updated for resources: {'Port': ['ID=361ec9aa-775c-4942-9aac-a9385710054a,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:52.617396 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:52.712210 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.714797 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:08:52.720922 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:52.729705 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:08:52.742298 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f94ef0b9-1df8-45d0-9548-9412be4c46c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.743360 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.758314 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-60bcd059-2ac0-4b64-9edb-f4cff3ce5416 req-73329cc9-c1fa-4ed9-ba8b-becc937351a0 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.3387408
Jun 01 11:08:52.797655 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:52.830982 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f94ef0b9-1df8-45d0-9548-9412be4c46c5 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=795b193986604f389e00476cd6b18352&name=default HTTP/1.1" status: 200  len: 2975 time: 0.8845561
Jun 01 11:08:52.830982 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f94ef0b9-1df8-45d0-9548-9412be4c46c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe749db9-3a65-45f0-b62c-84529b4debbc,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:52.833536 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56820) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:52.893734 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18b92654-af9b-41b7-8693-fb72c6004c59,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:52.902641 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=10822f465ef346a8afad5b03e0f36aec&name=default HTTP/1.1" status: 200  len: 2975 time: 0.9625483
Jun 01 11:08:52.908444 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56824) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:52.912728 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:52.913203 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.015s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:52.913545 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:52.931314 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:52.968933 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:52.996050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.022922 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-bd82ee10-bd54-40a8-82fc-89ab4718d437 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.050658 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Network 418faffe-faca-4025-ab0f-56771435263e is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:08:53.063955 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:53.068449 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:08:53.123109 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Pushing event updated for resources: {'Port': ['ID=27b19c3f-289e-417b-a07e-63b061c293a3,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:53.151531 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:53.178976 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:53.183362 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Attempting to bind port 27b19c3f-289e-417b-a07e-63b061c293a3 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:08:53.184868 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Attempting to bind port 27b19c3f-289e-417b-a07e-63b061c293a3 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:08:53.184868 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Attempting to bind port 27b19c3f-289e-417b-a07e-63b061c293a3 on network 418faffe-faca-4025-ab0f-56771435263e {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:08:53.187958 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-371d6421-6891-49e0-8b7e-420d168d8382 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.198821 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 8, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:08:53.199201 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Checking segment: {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:08:53.199629 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.200036 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Bound using segment: {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:08:53.200523 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Bound port: 27b19c3f-289e-417b-a07e-63b061c293a3, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:08:53.200904 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.214845 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Usage tracker for resource:security_group_rule and tenant:d8ad88caf25a4659bc7b10a359b62e60 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:53.240308 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:53.259739 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Allocated IP 172.27.3.245 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/8624cb8b-76b9-4f90-a661-444f15de47ab) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:08:53.265774 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:53.302794 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-371d6421-6891-49e0-8b7e-420d168d8382 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.330656 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] For port 27b19c3f-289e-417b-a07e-63b061c293a3, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:08:53.334866 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] For port 27b19c3f-289e-417b-a07e-63b061c293a3, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=27b19c3f-289e-417b-a07e-63b061c293a3,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:08:53.346317 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b1591306-0918-40cf-a0e3-16f337c04d7d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.346577 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.353596 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9fedcc6f-fc7d-404a-9c19-0df4276032f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:53.465209 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Pushing event updated for resources: {'Port': ['ID=27b19c3f-289e-417b-a07e-63b061c293a3,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:53.474829 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:53.517333 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-371d6421-6891-49e0-8b7e-420d168d8382 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.528041 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:53.554847 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device df5a5bab-5537-41fd-af8f-50c6c78af549 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:08:53.573676 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-371d6421-6891-49e0-8b7e-420d168d8382 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe749db9-3a65-45f0-b62c-84529b4debbc,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:53.581386 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-371d6421-6891-49e0-8b7e-420d168d8382 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:53.590711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.660439 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.720691 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-371d6421-6891-49e0-8b7e-420d168d8382 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.723657 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-371d6421-6891-49e0-8b7e-420d168d8382 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/fe749db9-3a65-45f0-b62c-84529b4debbc HTTP/1.1" status: 204  len: 168 time: 0.8309648
Jun 01 11:08:53.724827 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port df5a5bab-5537-41fd-af8f-50c6c78af549 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:08:53.949084 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b1591306-0918-40cf-a0e3-16f337c04d7d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:53.994978 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.005289 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8798d018-cac3-4f43-9120-29591478e983 None None] Network ce8e721a-c529-4460-882f-9261a0c7ceed requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:08:54.016325 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0d90f066-9ace-4fda-9b3c-1eecd62f9b6b req-5842893c-454f-41a7-8654-838284891c70 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.0655284
Jun 01 11:08:54.040702 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.058758 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:54.071491 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.094139 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-0b7ff5f5-69c3-4d8a-bcae-d6c9c98113df None None] Provisioning for port df5a5bab-5537-41fd-af8f-50c6c78af549 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:08:54.116667 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-0b7ff5f5-69c3-4d8a-bcae-d6c9c98113df None None] Provisioning complete for port df5a5bab-5537-41fd-af8f-50c6c78af549 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:08:54.117115 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0b7ff5f5-69c3-4d8a-bcae-d6c9c98113df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.219218 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=d8ad88caf25a4659bc7b10a359b62e60&name=default HTTP/1.1" status: 200  len: 2975 time: 1.6763070
Jun 01 11:08:54.222033 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 56856) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:54.255174 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=384a8a4e-3e6b-4595-b01d-39704c258155,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:54.278021 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.291071 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:54.293748 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b1591306-0918-40cf-a0e3-16f337c04d7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.368512 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f81825e1-ef6b-46f1-948b-92419d012c2b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.380518 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0b7ff5f5-69c3-4d8a-bcae-d6c9c98113df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.394218 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.79', 58702) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:54.444692 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-0b7ff5f5-69c3-4d8a-bcae-d6c9c98113df None None] For port df5a5bab-5537-41fd-af8f-50c6c78af549, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=df5a5bab-5537-41fd-af8f-50c6c78af549,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:08:54.451957 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0b7ff5f5-69c3-4d8a-bcae-d6c9c98113df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.458224 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:54.466135 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:54.537422 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1591306-0918-40cf-a0e3-16f337c04d7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18b92654-af9b-41b7-8693-fb72c6004c59,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:54.539904 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7ff5f5-69c3-4d8a-bcae-d6c9c98113df None None] Pushing event updated for resources: {'Port': ['ID=df5a5bab-5537-41fd-af8f-50c6c78af549,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:54.543393 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-0b7ff5f5-69c3-4d8a-bcae-d6c9c98113df None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:54.551238 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b1591306-0918-40cf-a0e3-16f337c04d7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:54.652619 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f81825e1-ef6b-46f1-948b-92419d012c2b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.666432 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b1591306-0918-40cf-a0e3-16f337c04d7d admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.667561 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-b1591306-0918-40cf-a0e3-16f337c04d7d admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/18b92654-af9b-41b7-8693-fb72c6004c59 HTTP/1.1" status: 204  len: 168 time: 1.7434886
Jun 01 11:08:54.755818 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-aef3666a-2863-4518-9a43-0a1e865ae9b9 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:54.758157 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-aef3666a-2863-4518-9a43-0a1e865ae9b9 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.79 "GET /v2.0/networks?id=16003d7c-7204-44bb-9e84-543e6390b879 HTTP/1.1" status: 200  len: 811 time: 0.3607819
Jun 01 11:08:54.863700 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Request body: {'port': {'device_id': '30bbda88-b979-4b36-bafb-eb3ae5baa20b', 'network_id': '16003d7c-7204-44bb-9e84-543e6390b879', 'admin_state_up': True, 'tenant_id': '0575695b945b453b9737182f6235cbe5'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:54.891990 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-b6fb66fe-bdcd-489e-a694-e4ff4890bfd7 None None] Provisioning complete for port df5a5bab-5537-41fd-af8f-50c6c78af549 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:08:54.892615 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b6fb66fe-bdcd-489e-a694-e4ff4890bfd7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.972101 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:54.992402 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:55.104873 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Pushing event updated for resources: {'Port': ['ID=8624cb8b-76b9-4f90-a661-444f15de47ab,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:55.111008 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:55.137733 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:08:55.143054 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:55.151185 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:08:55.165691 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d48e2efa-7fd4-48f9-8c7d-320d37487c23 None None] Network 418faffe-faca-4025-ab0f-56771435263e requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:08:55.272042 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Allocated IP 172.27.3.251 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/719565de-9fb7-4dd5-8529-d1ff8b32a498) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:08:55.441364 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:55.459830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f81825e1-ef6b-46f1-948b-92419d012c2b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:55.541806 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-cbe7f35d-5341-4613-ab81-69eb232b0b8d None None] Provisioning for port 27b19c3f-289e-417b-a07e-63b061c293a3 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:08:55.560501 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-498cc887-e540-47f6-859d-f371c72be219 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:55.562533 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:55.727421 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device df5a5bab-5537-41fd-af8f-50c6c78af549 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:08:55.735047 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:55.820043 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port df5a5bab-5537-41fd-af8f-50c6c78af549 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:08:55.820422 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:55.820948 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:55.829341 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:55.866210 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f81825e1-ef6b-46f1-948b-92419d012c2b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=384a8a4e-3e6b-4595-b01d-39704c258155,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:55.933485 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7af215e2-79e9-46f8-ac0a-e63f0bee0d8b req-72f34ba2-9a04-454f-9c57-ecbe85d2fed5 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.5780478
Jun 01 11:08:55.934355 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f81825e1-ef6b-46f1-948b-92419d012c2b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:55.943275 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f81825e1-ef6b-46f1-948b-92419d012c2b admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:55.947215 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f81825e1-ef6b-46f1-948b-92419d012c2b admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/384a8a4e-3e6b-4595-b01d-39704c258155 HTTP/1.1" status: 204  len: 168 time: 1.7242084
Jun 01 11:08:55.948450 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d48a1a00-7eb3-4b10-8c34-8b30f6d6b005 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:56.047011 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:08:56.076165 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 27b19c3f-289e-417b-a07e-63b061c293a3 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:08:56.094428 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:56.117144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:08:56.301536 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 27b19c3f-289e-417b-a07e-63b061c293a3 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:08:56.310157 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 27b19c3f-289e-417b-a07e-63b061c293a3 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:08:56.310546 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:56.395926 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:56.541073 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:56.614489 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Usage tracker for resource:port and tenant:0575695b945b453b9737182f6235cbe5 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:56.625013 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Quota usage for port was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:56.675037 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Pushing event updated for resources: {'Port': ['ID=719565de-9fb7-4dd5-8529-d1ff8b32a498,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:56.720873 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:56.732854 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:56.761314 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.813s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:56.807692 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Made reservation on behalf of 0575695b945b453b9737182f6235cbe5 for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:56.818816 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:56.880925 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-2261b49f-86e5-4f4a-acdb-2152d7c089d1 None None] Provisioning complete for port 27b19c3f-289e-417b-a07e-63b061c293a3 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:08:56.884963 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-2261b49f-86e5-4f4a-acdb-2152d7c089d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:57.037249 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Router 27b3b506-6634-49e2-b666-8f59cfd9cf96 is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119240) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:08:57.308985 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Allocated IP 172.20.0.5 (16003d7c-7204-44bb-9e84-543e6390b879/4244194d-2962-4661-95dd-d3f879a92c43/c568e1a6-7392-470c-80fa-8943b8cc84b5) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:08:57.317024 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-2261b49f-86e5-4f4a-acdb-2152d7c089d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:57.338843 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:57.424399 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 27b19c3f-289e-417b-a07e-63b061c293a3, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=27b19c3f-289e-417b-a07e-63b061c293a3,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:08:57.428186 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 56992) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:57.439910 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:57.442088 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-134ffcf2-ebf9-416b-8d33-91b17dd9e9ec req-0baaa97a-fec0-4f28-8269-2bece6d3c5c0 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.1417615
Jun 01 11:08:57.457222 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-b6750fc7-df28-4247-8b0c-709642cebb8e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:57.632395 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.db.api [None req-2261b49f-86e5-4f4a-acdb-2152d7c089d1 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=119242) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
Jun 01 11:08:57.635343 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_db.api [None req-2261b49f-86e5-4f4a-acdb-2152d7c089d1 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
Jun 01 11:08:57.636516 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=27b19c3f-289e-417b-a07e-63b061c293a3,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:57.645025 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:57.744183 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:57.843762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:08:57.859331 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Sync routers for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:08:57.871974 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:08:57.872773 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798742040>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:08:57.953869 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:58.030023 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1076004100-network', 'tenant_id': '53787281a5064c3fb8b987f0ad26c87d'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:08:58.055312 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:58.062574 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:58.063801 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-8161c593-96f3-44cf-ba7f-d80e9904f544 admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 8.6822212
Jun 01 11:08:58.067291 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57010) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:08:58.087313 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Usage tracker for resource:network and tenant:53787281a5064c3fb8b987f0ad26c87d is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:58.090428 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:58.420961 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:58.554241 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:58.574386 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:08:58.828090 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Made reservation on behalf of 53787281a5064c3fb8b987f0ad26c87d for: {'network': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:08:58.830511 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:58.871401 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-74c88ca4-9243-4802-beea-12b77c9cf019 req-5e999494-892f-4c29-8947-394a2b5e576a tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.1300600
Jun 01 11:08:58.904852 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:59.021202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:59.024756 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:59.138758 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798742040>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:08:53Z', 'revision_number': 3, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:08:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:08:59.150848 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Checking router: 27b3b506-6634-49e2-b666-8f59cfd9cf96 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:08:59.151562 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Updating router 27b3b506-6634-49e2-b666-8f59cfd9cf96 port 361ec9aa-775c-4942-9aac-a9385710054a binding host dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:08:59.222561 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:08:59.238191 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Usage tracker for resource:security_group_rule and tenant:53787281a5064c3fb8b987f0ad26c87d is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:08:59.250044 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:59.253383 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:08:59.270164 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:08:59.272403 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:59.272547 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:08:59.366249 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Network 16003d7c-7204-44bb-9e84-543e6390b879 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:08:59.373080 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:08:59.378771 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:08:59.384719 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:08:59.385355 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:08:59.401875 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Pushing event updated for resources: {'Port': ['ID=c568e1a6-7392-470c-80fa-8943b8cc84b5,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:08:59.410130 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:08:59.427275 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 4.5863931
Jun 01 11:08:59.428648 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Router 51d6b52d-91aa-469c-9023-bb7143053ec7 is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119241) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:08:59.569217 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 27b19c3f-289e-417b-a07e-63b061c293a3 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:08:59.718371 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-4c096e7b-3bc9-4f38-8463-1687695c1728 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119241) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:08:59.720229 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-4c096e7b-3bc9-4f38-8463-1687695c1728 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.79 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0352595
Jun 01 11:08:59.895046 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 27b19c3f-289e-417b-a07e-63b061c293a3 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:08:59.895427 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:00.086176 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:09:00.104329 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Sync routers for ids ['51d6b52d-91aa-469c-9023-bb7143053ec7'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:09:00.127188 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Router abf03e4b-fdd0-44b3-86be-277da7892b4a is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119240) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:09:00.185861 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Routers {'51d6b52d-91aa-469c-9023-bb7143053ec7'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:00.200056 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57981fdcd0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['51d6b52d-91aa-469c-9023-bb7143053ec7'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:00.335035 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Notify callbacks [] for port, precommit_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:00.348884 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] Notify callbacks [] for router, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:00.357901 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-e2e84b25-07c3-41d8-9221-7eb616113667 admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 9.0346708
Jun 01 11:09:00.359513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57060) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:00.394275 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.provisioning_blocks [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Transition to ACTIVE for port object 361ec9aa-775c-4942-9aac-a9385710054a will not be triggered until provisioned by entity L2. {{(pid=119243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:00.417194 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:00.430166 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:00.534633 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225d0435-10fe-4cdd-aa34-3d548fef5d97 req-20199742-8add-436a-a290-213193898895 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:00.535390 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-225d0435-10fe-4cdd-aa34-3d548fef5d97 req-20199742-8add-436a-a290-213193898895 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Synchronizing usage tracker for tenant:0575695b945b453b9737182f6235cbe5 on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:00.694998 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Attempting to bind port 361ec9aa-775c-4942-9aac-a9385710054a on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:00.703450 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Attempting to bind port 361ec9aa-775c-4942-9aac-a9385710054a by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:00.705240 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Attempting to bind port 361ec9aa-775c-4942-9aac-a9385710054a on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:00.715096 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Pushing event updated for resources: {'Port': ['ID=361ec9aa-775c-4942-9aac-a9385710054a,revision_number=2']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:00.735044 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.735421 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.738629 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.739035 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.739627 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.739878 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.740288 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.743064 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.743331 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.743776 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.744154 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.744879 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Tracked resource versions report:
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]: pushed versions:
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]: {   'AddressGroup': {'1.2'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'ConntrackHelper': {'1.0'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Log': {'1.0'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Network': {'1.1'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Port': {'1.7'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'PortForwarding': {'1.2'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'QosPolicy': {'1.8'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'SecurityGroup': {'1.4'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'SecurityGroupRule': {'1.2'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'SubPort': {'1.0'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Subnet': {'1.1'},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     'Trunk': {'1.1'}}
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]: consumer versions:
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]: {   DHCP agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     HyperV agent@hv-cinder-78776: {},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     L3 agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     Metadata agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     Metering agent@dv-cinder-787764-3-iscsi: {},
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:     Open vSwitch agent@dv-cinder-787764-3-iscsi: {   'AddressGroup': '1.2',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'ConntrackHelper': '1.0',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Log': '1.0',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Network': '1.1',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Port': '1.7',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'PortForwarding': '1.2',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'QosPolicy': '1.8',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'SecurityGroup': '1.4',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'SecurityGroupRule': '1.2',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'SubPort': '1.0',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Subnet': '1.1',
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:                                                      'Trunk': '1.1'}}
Jun 01 11:09:00.745628 dv-cinder-787764-3-iscsi neutron-server[119243]:  {{(pid=119243) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 11:09:00.759989 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 8, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:00.760381 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:00.761055 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Set router 51d6b52d-91aa-469c-9023-bb7143053ec7 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:00.764293 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:00.765333 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:00.766001 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Bound port: 361ec9aa-775c-4942-9aac-a9385710054a, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:00.766445 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:00.825308 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.396s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:00.939071 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] For port 361ec9aa-775c-4942-9aac-a9385710054a, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:00.946726 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] For port 361ec9aa-775c-4942-9aac-a9385710054a, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=361ec9aa-775c-4942-9aac-a9385710054a,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:00.955213 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:00.964843 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-8a13137e-761d-4a4a-8451-18893b4df6d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:00.990602 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-225d0435-10fe-4cdd-aa34-3d548fef5d97 req-20199742-8add-436a-a290-213193898895 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Unset dirty status for tenant:0575695b945b453b9737182f6235cbe5 on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:01.001905 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-225d0435-10fe-4cdd-aa34-3d548fef5d97 req-20199742-8add-436a-a290-213193898895 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 931 time: 0.8531580
Jun 01 11:09:01.023360 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:01.058861 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:01.097648 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 665}  {{(pid=119240) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:09:01.126956 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:01.127697 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.segments_db [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Added segment c863fd7d-d33b-435e-bd84-4d5c578be46f of type vlan for network 3a3df211-07f0-4913-a977-3d2916782078
Jun 01 11:09:01.153483 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:01.155826 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798742040>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:01.176088 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:01.232063 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-bb19d5f6-7f0f-485d-bf0e-cb609cbad57d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:01.262820 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:09:01.309470 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:01.392456 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Sync routers for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:09:01.456562 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Pushing event updated for resources: {'Port': ['ID=361ec9aa-775c-4942-9aac-a9385710054a,revision_number=3']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:01.465532 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.502s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:01.486787 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57981fdcd0>, [{'id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251'}], 'enable_snat': True}, 'gw_port_id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:08:56Z', 'revision_number': 3, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'gw_port': {'id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:6f:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:53Z', 'updated_at': '2021-06-01T11:08:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:01.495613 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Checking router: 51d6b52d-91aa-469c-9023-bb7143053ec7 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:09:01.496516 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Updating router 51d6b52d-91aa-469c-9023-bb7143053ec7 port 719565de-9fb7-4dd5-8529-d1ff8b32a498 binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:09:01.533378 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:01.533976 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:01.537786 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:01.539166 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 11.2704980
Jun 01 11:09:01.550874 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:01.587850 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:01.588951 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57092) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:01.604414 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Request body: {'port': {'device_id': '30bbda88-b979-4b36-bafb-eb3ae5baa20b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:01.628791 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4009dde3-16ab-4f86-8215-85d0ebbba364,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:01.691279 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:01.700779 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798204c40>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:01.705732 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.474s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:01.832025 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.282s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:02.075282 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:02.198601 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-225d0435-10fe-4cdd-aa34-3d548fef5d97 req-a38eec09-8358-48f1-8146-b2540dc77d16 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.1958098
Jun 01 11:09:02.199215 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57102) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:02.266831 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:02.291120 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:02.319490 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Transition to ACTIVE for port object 719565de-9fb7-4dd5-8529-d1ff8b32a498 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:02.320627 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Allocated IP 172.20.0.1 (ce8e721a-c529-4460-882f-9261a0c7ceed/79a8ddfd-a675-47e5-9921-33f71f58d781/edb1a8b5-7020-4904-83c6-aafe25fb115f) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:09:02.333509 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:02.342696 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:02.497603 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-416be2c1-38f2-44eb-94c5-eaa71b0ecf8c None None] Pushing event updated for resources: {'Port': ['ID=719565de-9fb7-4dd5-8529-d1ff8b32a498,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:02.505307 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-416be2c1-38f2-44eb-94c5-eaa71b0ecf8c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:02.537508 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 5.1056209
Jun 01 11:09:02.550305 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Attempting to bind port 719565de-9fb7-4dd5-8529-d1ff8b32a498 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:02.551952 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57114) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:02.553304 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Attempting to bind port 719565de-9fb7-4dd5-8529-d1ff8b32a498 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:02.554101 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Attempting to bind port 719565de-9fb7-4dd5-8529-d1ff8b32a498 on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:02.570140 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 8, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:02.571880 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:02.572381 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:02.574062 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:02.574793 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Bound port: 719565de-9fb7-4dd5-8529-d1ff8b32a498, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:02.576041 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:02.613864 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Request body: {'subnet': {'network_id': '3a3df211-07f0-4913-a977-3d2916782078', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1076004100-subnet', 'tenant_id': '53787281a5064c3fb8b987f0ad26c87d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:02.740495 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Pushing event updated for resources: {'Network': ['ID=3a3df211-07f0-4913-a977-3d2916782078,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:02.744189 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:02.768322 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 3a3df211-07f0-4913-a977-3d2916782078 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:09:02.779431 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Usage tracker for resource:subnet and tenant:53787281a5064c3fb8b987f0ad26c87d is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:02.789153 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.957s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:02.792554 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:02.846684 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] For port 719565de-9fb7-4dd5-8529-d1ff8b32a498, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:02.859729 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:02.891940 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:02.928483 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:03.040916 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] For port 719565de-9fb7-4dd5-8529-d1ff8b32a498, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=719565de-9fb7-4dd5-8529-d1ff8b32a498,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:03.057775 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:03.085213 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:03.085657 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:03.129364 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:03.179564 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Transition to ACTIVE for port object edb1a8b5-7020-4904-83c6-aafe25fb115f will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:03.271373 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Allocated IP 172.20.0.1 (e8c7dea7-722b-446b-9e9f-d27643e48187/069e04dd-9d3b-4ce0-997c-7cfc632b4fe3/797df9ad-f50f-4533-9c1f-65512bddf40a) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:09:03.467924 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Routers {'51d6b52d-91aa-469c-9023-bb7143053ec7'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:03.468568 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57981fdcd0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['51d6b52d-91aa-469c-9023-bb7143053ec7'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:03.582485 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:03.626272 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-416be2c1-38f2-44eb-94c5-eaa71b0ecf8c None None] Pushing event updated for resources: {'Port': ['ID=719565de-9fb7-4dd5-8529-d1ff8b32a498,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:03.645044 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57128) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:03.648423 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-416be2c1-38f2-44eb-94c5-eaa71b0ecf8c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.519s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:03.734205 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:03.760006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Made reservation on behalf of 53787281a5064c3fb8b987f0ad26c87d for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:09:03.764818 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Notify callbacks [] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:03.962798 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:03.966080 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Usage tracker for resource:security_group_rule and tenant:fa5200091e6e4d6d9d5ecee2995471ac is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:04.012659 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:04.025034 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:04.042057 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] Set router 51d6b52d-91aa-469c-9023-bb7143053ec7 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:04.065868 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798742040>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:08:53Z', 'revision_number': 3, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:04.068785 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-92b4d1ed-0b4b-4885-ae15-f8b98afc2b50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:04.086576 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e9c5f97-644a-4157-a0dc-b447bfa7d04a None None] The sync data for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi is: [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:08:53Z', 'revision_number': 3, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:09:04.196633 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Pushing event updated for resources: {'Port': ['ID=edb1a8b5-7020-4904-83c6-aafe25fb115f,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:04.202151 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798204c40>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:08:55Z', 'revision_number': 3, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:08:53Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:04.220752 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Checking router: abf03e4b-fdd0-44b3-86be-277da7892b4a for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:09:04.221085 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Updating router abf03e4b-fdd0-44b3-86be-277da7892b4a port 8624cb8b-76b9-4f90-a661-444f15de47ab binding host dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:09:04.309512 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:04.330843 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:04.376941 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:04.393820 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Network ce8e721a-c529-4460-882f-9261a0c7ceed is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:04.425800 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:04.432217 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:09:04.432673 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:04.439620 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Network e8c7dea7-722b-446b-9e9f-d27643e48187 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:04.441041 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:04.544856 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:04.603145 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:04.812294 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57981fdcd0>, [{'id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251'}], 'enable_snat': True}, 'gw_port_id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:08:56Z', 'revision_number': 3, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'gw_port': {'id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:6f:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:53Z', 'updated_at': '2021-06-01T11:09:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:04.812294 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6da886d3-0d31-4eda-a8c3-0f6fceb5b342 None None] The sync data for ids ['51d6b52d-91aa-469c-9023-bb7143053ec7'] in dv-cinder-787764-3-iscsi is: [{'id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251'}], 'enable_snat': True}, 'gw_port_id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:08:56Z', 'revision_number': 3, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'gw_port': {'id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:6f:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:53Z', 'updated_at': '2021-06-01T11:09:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:09:04.989956 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-7783754d-6fe0-42e3-b69b-9d93e376e5d9 None None] Provisioning for port edb1a8b5-7020-4904-83c6-aafe25fb115f completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:05.004499 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-7783754d-6fe0-42e3-b69b-9d93e376e5d9 None None] Provisioning complete for port edb1a8b5-7020-4904-83c6-aafe25fb115f triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:05.004880 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7783754d-6fe0-42e3-b69b-9d93e376e5d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:05.168461 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-7783754d-6fe0-42e3-b69b-9d93e376e5d9 None None] Port edb1a8b5-7020-4904-83c6-aafe25fb115f cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:09:05.219038 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:09:05.220401 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:05.291416 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Notify callbacks [] for port, precommit_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:05.333182 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.provisioning_blocks [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Transition to ACTIVE for port object 8624cb8b-76b9-4f90-a661-444f15de47ab will not be triggered until provisioned by entity L2. {{(pid=119243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:05.343542 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:05.352473 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:05.357949 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:05.476745 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Pushing event updated for resources: {'Port': ['ID=797df9ad-f50f-4533-9c1f-65512bddf40a,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:05.558283 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:05.604296 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Attempting to bind port 8624cb8b-76b9-4f90-a661-444f15de47ab on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:05.611567 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Allocated IP 172.20.0.1 (418faffe-faca-4025-ab0f-56771435263e/08c4a15d-0d06-4d4b-909f-10ac28c5c16c/d5daee11-02d5-400a-872b-52ebf2382ec6) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:09:05.612022 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Attempting to bind port 8624cb8b-76b9-4f90-a661-444f15de47ab by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:05.612180 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.282s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:05.613104 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Attempting to bind port 8624cb8b-76b9-4f90-a661-444f15de47ab on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:05.632541 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-190a8c27-387d-4687-bad9-854939887098 None None] Pushing event updated for resources: {'Port': ['ID=8624cb8b-76b9-4f90-a661-444f15de47ab,revision_number=2']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:05.637385 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-190a8c27-387d-4687-bad9-854939887098 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.279s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:05.647129 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 8, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:05.649019 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:05.649605 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:05.650166 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:05.651713 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Bound port: 8624cb8b-76b9-4f90-a661-444f15de47ab, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:05.652268 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:05.652876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:05.724727 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 719565de-9fb7-4dd5-8529-d1ff8b32a498 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:05.841585 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Usage tracker for resource:security_group_rule and tenant:1688ee6be5614792929e7496d0248f21 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:05.888249 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] For port 8624cb8b-76b9-4f90-a661-444f15de47ab, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:05.895499 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] For port 8624cb8b-76b9-4f90-a661-444f15de47ab, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=8624cb8b-76b9-4f90-a661-444f15de47ab,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:05.908778 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:05.914164 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:05.917944 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 719565de-9fb7-4dd5-8529-d1ff8b32a498 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:05.932450 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 719565de-9fb7-4dd5-8529-d1ff8b32a498 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:05.933085 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.059208 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:06.091312 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f056fd9-e602-42fd-a6e1-3d03f9adc288 req-3731c078-1900-4d43-b18e-177ef108832f tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:06.094724 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2f056fd9-e602-42fd-a6e1-3d03f9adc288 req-3731c078-1900-4d43-b18e-177ef108832f tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 931 time: 2.4461980
Jun 01 11:09:06.130763 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:06.131417 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798204c40>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:06.179001 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:06.313707 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.356695 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 719565de-9fb7-4dd5-8529-d1ff8b32a498, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=719565de-9fb7-4dd5-8529-d1ff8b32a498,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:06.362296 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.363532 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 361ec9aa-775c-4942-9aac-a9385710054a up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:06.384518 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2f056fd9-e602-42fd-a6e1-3d03f9adc288 req-c799cbca-c46c-4c3c-b693-fe3cbba97410 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2319791
Jun 01 11:09:06.435239 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:06.441415 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.516841 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.519388 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Transition to ACTIVE for port object d5daee11-02d5-400a-872b-52ebf2382ec6 will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:06.531531 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:06.539187 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.541937 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.546998 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:06.618592 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=719565de-9fb7-4dd5-8529-d1ff8b32a498,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:06.632503 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:06.645997 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 361ec9aa-775c-4942-9aac-a9385710054a completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:06.660255 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 361ec9aa-775c-4942-9aac-a9385710054a triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:06.661878 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.768154 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Pushing event updated for resources: {'Port': ['ID=edb1a8b5-7020-4904-83c6-aafe25fb115f,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:06.814624 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:06.830456 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.849762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:06.892783 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:06.961985 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Network 418faffe-faca-4025-ab0f-56771435263e is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:06.974758 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-190a8c27-387d-4687-bad9-854939887098 None None] Pushing event updated for resources: {'Port': ['ID=8624cb8b-76b9-4f90-a661-444f15de47ab,revision_number=3']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:06.995495 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-190a8c27-387d-4687-bad9-854939887098 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.081s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:06.998808 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.009787 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.028088 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Pushing event updated for resources: {'Port': ['ID=d5daee11-02d5-400a-872b-52ebf2382ec6,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:07.039223 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:07.041903 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 361ec9aa-775c-4942-9aac-a9385710054a, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=361ec9aa-775c-4942-9aac-a9385710054a,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:07.048461 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.051678 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:07.061637 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:07.099050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:09:07.100957 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.126412 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0f5cfb48-1333-44ea-8759-e38960d14248 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:07.139453 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=fa5200091e6e4d6d9d5ecee2995471ac&name=default HTTP/1.1" status: 200  len: 2979 time: 4.9185789
Jun 01 11:09:07.155551 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57148) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:07.183133 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.237417 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=361ec9aa-775c-4942-9aac-a9385710054a,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:07.274169 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:07.279718 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.279718 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c568e1a6-7392-470c-80fa-8943b8cc84b5 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:07.331941 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.338523 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.361091 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0c88e93f-f543-44b0-abd4-ca821c562afd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.384140 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2c47141-cb07-405d-a167-88324427c1bd,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:07.413404 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Network ce8e721a-c529-4460-882f-9261a0c7ceed is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:07.423306 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:07.430692 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0c88e93f-f543-44b0-abd4-ca821c562afd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.467093 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.341s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:07.469735 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.124s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:07.540859 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798204c40>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:08:55Z', 'revision_number': 3, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:07.552639 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-539d3596-640c-41c1-9abb-9bd32174a83e None None] The sync data for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi is: [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:08:55Z', 'revision_number': 3, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:09:07.597023 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Transition to ACTIVE for port object c568e1a6-7392-470c-80fa-8943b8cc84b5 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:07.610623 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=1688ee6be5614792929e7496d0248f21&name=default HTTP/1.1" status: 200  len: 2979 time: 3.8794329
Jun 01 11:09:07.616892 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.620327 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-510f0363-6426-4d55-967f-c24483380776 None None] Provisioning for port d5daee11-02d5-400a-872b-52ebf2382ec6 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:07.635283 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4cb6b50-bb7f-4613-b379-7a2a84851c71,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:07.637647 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57156) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:07.650157 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 719565de-9fb7-4dd5-8529-d1ff8b32a498 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:07.664478 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:07.672281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-dcaabc26-e1eb-4fcd-9166-0cf9f3383dd4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.251s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:07.713315 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-510f0363-6426-4d55-967f-c24483380776 None None] Provisioning complete for port d5daee11-02d5-400a-872b-52ebf2382ec6 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:07.713745 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-510f0363-6426-4d55-967f-c24483380776 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.761889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.775975 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=44efc8dd-3e88-44e1-a35d-8a10bcee9867,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:07.783072 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:07.817323 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-510f0363-6426-4d55-967f-c24483380776 None None] Port d5daee11-02d5-400a-872b-52ebf2382ec6 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:09:07.824146 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:07.842231 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 719565de-9fb7-4dd5-8529-d1ff8b32a498 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:07.843398 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:07.934010 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Router 27b3b506-6634-49e2-b666-8f59cfd9cf96 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:09:07.964309 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Pushing event updated for resources: {'Port': ['ID=c568e1a6-7392-470c-80fa-8943b8cc84b5,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:07.967964 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:07.968721 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Checking segment: {'id': 'c863fd7d-d33b-435e-bd84-4d5c578be46f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '3a3df211-07f0-4913-a977-3d2916782078'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:07.969074 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Network hostable DHCP agents. Network: 3a3df211-07f0-4913-a977-3d2916782078, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:09:08.014057 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-17378758-6f42-448e-8e81-90f60be176cf None None] Provisioning complete for port edb1a8b5-7020-4904-83c6-aafe25fb115f triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:08.016644 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-17378758-6f42-448e-8e81-90f60be176cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.032704 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0c88e93f-f543-44b0-abd4-ca821c562afd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.055842 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:08.058809 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 361ec9aa-775c-4942-9aac-a9385710054a up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:08.157989 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-17378758-6f42-448e-8e81-90f60be176cf None None] Port edb1a8b5-7020-4904-83c6-aafe25fb115f cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:09:08.198833 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 361ec9aa-775c-4942-9aac-a9385710054a triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:08.199990 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.240369 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d87f7530-fd26-47f3-ac5c-4d6d999ea5dc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.242490 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Network 3a3df211-07f0-4913-a977-3d2916782078 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:09:08.246185 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0c88e93f-f543-44b0-abd4-ca821c562afd admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.250206 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-0c88e93f-f543-44b0-abd4-ca821c562afd admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/d2c47141-cb07-405d-a167-88324427c1bd HTTP/1.1" status: 204  len: 168 time: 1.0784504
Jun 01 11:09:08.269590 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c88e93f-f543-44b0-abd4-ca821c562afd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2c47141-cb07-405d-a167-88324427c1bd,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:08.313993 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0c88e93f-f543-44b0-abd4-ca821c562afd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:08.352258 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.377311 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:09:08.408866 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] 10.222.0.74 "PUT /v2.0/routers/27b3b506-6634-49e2-b666-8f59cfd9cf96/add_router_interface HTTP/1.1" status: 200  len: 503 time: 10.3235848
Jun 01 11:09:08.416889 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Sync routers for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:09:08.458227 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:08.459132 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57982ae040>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:08.492594 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Attempting to bind port c568e1a6-7392-470c-80fa-8943b8cc84b5 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:08.493225 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Attempting to bind port c568e1a6-7392-470c-80fa-8943b8cc84b5 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '989f88ce-9ed9-4d44-aabd-f14b3be6c3d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 660, 'network_id': '16003d7c-7204-44bb-9e84-543e6390b879'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:08.493340 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Attempting to bind port c568e1a6-7392-470c-80fa-8943b8cc84b5 on network 16003d7c-7204-44bb-9e84-543e6390b879 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:08.522869 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d87f7530-fd26-47f3-ac5c-4d6d999ea5dc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.644423 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Port c568e1a6-7392-470c-80fa-8943b8cc84b5 on network 16003d7c-7204-44bb-9e84-543e6390b879 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:09:08.644845 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Attempting to bind port c568e1a6-7392-470c-80fa-8943b8cc84b5 on network 16003d7c-7204-44bb-9e84-543e6390b879 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:08.665268 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de176361-02bf-44b5-9a78-fd80ca5f0397 req-200b6e9c-1e33-407f-91a9-cb66ebf5b679 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:08.669729 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-de176361-02bf-44b5-9a78-fd80ca5f0397 req-200b6e9c-1e33-407f-91a9-cb66ebf5b679 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 943 time: 0.8943374
Jun 01 11:09:08.669729 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d87f7530-fd26-47f3-ac5c-4d6d999ea5dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.670136 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 3a3df211-07f0-4913-a977-3d2916782078) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:08.695767 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:08.696537 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.756519 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe3b1341-1f14-4048-a9ee-173641587572 None None] Network 3a3df211-07f0-4913-a977-3d2916782078 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:09:08.764358 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4acb2a87-4379-459e-97dc-dcd01be32bd9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:08.839327 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.846096 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.847984 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d87f7530-fd26-47f3-ac5c-4d6d999ea5dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4cb6b50-bb7f-4613-b379-7a2a84851c71,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:08.848437 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.856521 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d87f7530-fd26-47f3-ac5c-4d6d999ea5dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:08.857586 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 8, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:08.858102 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Checking segment: {'id': '989f88ce-9ed9-4d44-aabd-f14b3be6c3d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 660, 'network_id': '16003d7c-7204-44bb-9e84-543e6390b879'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:08.859397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Bound using segment: {'id': '989f88ce-9ed9-4d44-aabd-f14b3be6c3d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 660, 'network_id': '16003d7c-7204-44bb-9e84-543e6390b879'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:08.860145 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Bound port: c568e1a6-7392-470c-80fa-8943b8cc84b5, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '989f88ce-9ed9-4d44-aabd-f14b3be6c3d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 660, 'network_id': '16003d7c-7204-44bb-9e84-543e6390b879'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:08.860643 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.862978 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7d4c8d87-0bb4-4365-a9e5-dde9d65cddb3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:08.873508 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d87f7530-fd26-47f3-ac5c-4d6d999ea5dc admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:08.874913 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d87f7530-fd26-47f3-ac5c-4d6d999ea5dc admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/d4cb6b50-bb7f-4613-b379-7a2a84851c71 HTTP/1.1" status: 204  len: 168 time: 1.2265668
Jun 01 11:09:08.889623 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 6.2833879
Jun 01 11:09:08.936669 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-de176361-02bf-44b5-9a78-fd80ca5f0397 req-2f0ba33b-bee6-435b-adb7-b2772cd168c9 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2355468
Jun 01 11:09:08.984522 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:09.060702 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:09.069546 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:09.071982 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:09.076688 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] For port c568e1a6-7392-470c-80fa-8943b8cc84b5, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:09.080365 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:09.150425 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Pushing event updated for resources: {'Port': ['ID=d5daee11-02d5-400a-872b-52ebf2382ec6,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:09.181035 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] For port c568e1a6-7392-470c-80fa-8943b8cc84b5, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c568e1a6-7392-470c-80fa-8943b8cc84b5,segment=NetworkSegment(989f88ce-9ed9-4d44-aabd-f14b3be6c3d4),segment_id=989f88ce-9ed9-4d44-aabd-f14b3be6c3d4)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:09.186144 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:09.271766 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Network 418faffe-faca-4025-ab0f-56771435263e is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:09.273257 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:09.305112 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:09.319621 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Pushing event updated for resources: {'Port': ['ID=797df9ad-f50f-4533-9c1f-65512bddf40a,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:09.328585 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:09.367509 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:09.569648 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:09.570327 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:09.571795 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] 10.222.0.79 "PUT /v2.0/ports/c568e1a6-7392-470c-80fa-8943b8cc84b5 HTTP/1.1" status: 200  len: 1093 time: 9.0213802
Jun 01 11:09:09.572389 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '30bbda88-b979-4b36-bafb-eb3ae5baa20b', 'tag': 'c568e1a6-7392-470c-80fa-8943b8cc84b5'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:09.777832 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Router abf03e4b-fdd0-44b3-86be-277da7892b4a has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:09:09.947313 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Pushing event updated for resources: {'Port': ['ID=c568e1a6-7392-470c-80fa-8943b8cc84b5,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:09.962948 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.588s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:09.975084 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Network e8c7dea7-722b-446b-9e9f-d27643e48187 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:09.984548 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:09.987869 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 8624cb8b-76b9-4f90-a661-444f15de47ab up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:10.153650 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57208) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:10.190773 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-c8db9ca8-f748-45a4-b84b-549b90ef0cbe None None] Provisioning complete for port d5daee11-02d5-400a-872b-52ebf2382ec6 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:10.191155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c8db9ca8-f748-45a4-b84b-549b90ef0cbe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:10.237684 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:10.293417 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:09:10.317367 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] 10.222.0.74 "PUT /v2.0/routers/abf03e4b-fdd0-44b3-86be-277da7892b4a/add_router_interface HTTP/1.1" status: 200  len: 503 time: 8.6937585
Jun 01 11:09:10.355747 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-c8db9ca8-f748-45a4-b84b-549b90ef0cbe None None] Port d5daee11-02d5-400a-872b-52ebf2382ec6 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:09:10.368471 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f650aaa-9d2c-479b-beeb-2390ba08c1b8 None None] Network 3a3df211-07f0-4913-a977-3d2916782078 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:09:10.406619 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:10.411247 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57222) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:10.417237 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'security_group': {'name': 'tempest-securitygroup--310374559', 'description': 'tempest-description--1937599072'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:10.426886 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Usage tracker for resource:security_group_rule and tenant:b64917f8e849491b8f60b4af6a5e813c is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:10.427404 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:10.448913 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:security_group and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:10.468615 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:10.508623 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:10.536338 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:10.546120 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:10.546852 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-34ab130b-d15a-4306-88f0-672f074d4fbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:10.548390 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-34ab130b-d15a-4306-88f0-672f074d4fbd service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=0575695b945b453b9737182f6235cbe5&device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 1096 time: 0.8680818
Jun 01 11:09:10.551718 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 8624cb8b-76b9-4f90-a661-444f15de47ab completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:10.592090 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 8624cb8b-76b9-4f90-a661-444f15de47ab triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:10.592465 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:10.599280 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:10.607178 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:security_group_rule and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:10.611932 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:10.612720 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:10.624192 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:10.624388 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0" -d '{"events": [{"name": "network-changed", "server_uuid": "30bbda88-b979-4b36-bafb-eb3ae5baa20b", "tag": "c568e1a6-7392-470c-80fa-8943b8cc84b5"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:10.724604 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Sync routers for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:09:10.735093 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:10.739384 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57982044c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:10.753536 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:10.763018 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:10.769084 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:10.806513 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0ff5b0bd-43c2-4935-8de2-ae5b93edb9e3 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c568e1a6-7392-470c-80fa-8943b8cc84b5 HTTP/1.1" status: 200  len: 217 time: 0.2236469
Jun 01 11:09:10.811693 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'SecurityGroup': ['ID=597e6795-c293-4730-a3b5-4cd55da732ae,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:10.829386 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:10.831518 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:10.833239 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4209230
Jun 01 11:09:10.836162 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57238) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:10.848560 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'security_group_rule': {'security_group_id': '597e6795-c293-4730-a3b5-4cd55da732ae', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:10.855936 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Router 51d6b52d-91aa-469c-9023-bb7143053ec7 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:09:10.863456 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:10.870971 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:security_group_rule and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:10.876685 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102b6854-855b-4848-9155-3af553c50ae5 req-478ea0e2-83cb-4eda-8e79-8b863e4eceb6 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:10.878412 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-102b6854-855b-4848-9155-3af553c50ae5 req-478ea0e2-83cb-4eda-8e79-8b863e4eceb6 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 943 time: 0.6227951
Jun 01 11:09:10.884168 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:10.892448 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:10.921542 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:10.932519 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57982ae040>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:05Z', 'revision_number': 2, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:10.978591 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Checking router: 27b3b506-6634-49e2-b666-8f59cfd9cf96 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:09:10.979310 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Updating router 27b3b506-6634-49e2-b666-8f59cfd9cf96 port edb1a8b5-7020-4904-83c6-aafe25fb115f binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:09:11.014272 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.058149 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.076471 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.076633 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.082834 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.087111 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.088871 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:11.111721 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 8624cb8b-76b9-4f90-a661-444f15de47ab, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=8624cb8b-76b9-4f90-a661-444f15de47ab,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:11.116084 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9ced7d4c-6490-4574-ad5a-7180bcdda771,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:11.131701 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:11.162673 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.169112 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:11.172658 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.174194 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3365953
Jun 01 11:09:11.175948 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:11.176813 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57248) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:11.182094 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'security_group_rule': {'security_group_id': '597e6795-c293-4730-a3b5-4cd55da732ae', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:11.199808 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:11.208212 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:security_group_rule and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:11.212908 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:11.213430 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:11.228771 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:11.264355 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.285551 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b353ce9-2e68-4d5d-817c-368eccc7deb7,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:11.293406 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57252) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:11.294991 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:11.354248 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-102b6854-855b-4848-9155-3af553c50ae5 req-ee37f600-70db-42c1-9d13-46e21f7ae006 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4653542
Jun 01 11:09:11.367955 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-553156585-network', 'tenant_id': 'e7a1c67b334348f6bb68128495ee8603'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:11.371343 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=b64917f8e849491b8f60b4af6a5e813c&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1855392
Jun 01 11:09:11.372117 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57258) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:11.394886 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:11.405601 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Usage tracker for resource:network and tenant:e7a1c67b334348f6bb68128495ee8603 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:11.413767 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:11.423939 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:11.459457 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=8624cb8b-76b9-4f90-a661-444f15de47ab,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:11.473456 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Made reservation on behalf of e7a1c67b334348f6bb68128495ee8603 for: {'network': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:09:11.486873 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.519631 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57264) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:11.552600 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.554847 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1731120544', 'description': 'tempest-description--483648877'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:11.620478 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:11.641401 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:11.665017 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Usage tracker for resource:security_group_rule and tenant:e7a1c67b334348f6bb68128495ee8603 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:11.679000 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:security_group and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:11.685884 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:11.692405 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.704054 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:11.713027 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.728729 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7726732e-a338-43d6-842d-f62fb1a8498c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:11.749911 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:11.770919 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e58ac902-fcfc-4ddd-84cf-0fb1c939ed95 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.779326 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2d16e410-270a-4861-a011-d68bf33da46c,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:11.793809 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.625s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:11.798334 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 8624cb8b-76b9-4f90-a661-444f15de47ab up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:11.813477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:11.821709 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:11.824833 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:09:11.878992 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] 10.222.0.74 "PUT /v2.0/routers/51d6b52d-91aa-469c-9023-bb7143053ec7/add_router_interface HTTP/1.1" status: 200  len: 503 time: 11.4982109
Jun 01 11:09:11.885262 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.885775 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.889513 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.7085094
Jun 01 11:09:11.892279 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57278) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:11.915292 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'floatingip': {'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:11.923788 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:11.928698 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e58ac902-fcfc-4ddd-84cf-0fb1c939ed95 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:11.938452 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:floatingip and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:11.946964 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Sync routers for ids ['51d6b52d-91aa-469c-9023-bb7143053ec7'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:09:11.951096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7927d513-1090-45a3-a74e-a0b18b01f703 x-openstack-request-id: req-7927d513-1090-45a3-a74e-a0b18b01f703 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:11.951401 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "30bbda88-b979-4b36-bafb-eb3ae5baa20b", "tag": "c568e1a6-7392-470c-80fa-8943b8cc84b5", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:11.954391 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:11.962792 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-7927d513-1090-45a3-a74e-a0b18b01f703 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:11.963423 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '30bbda88-b979-4b36-bafb-eb3ae5baa20b', 'tag': 'c568e1a6-7392-470c-80fa-8943b8cc84b5', 'status': 'completed', 'code': 200}
Jun 01 11:09:11.975371 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:11.992132 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Routers {'51d6b52d-91aa-469c-9023-bb7143053ec7'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:11.993630 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579873ebe0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['51d6b52d-91aa-469c-9023-bb7143053ec7'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:11.999955 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57982044c0>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 2, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:12.005351 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Checking router: abf03e4b-fdd0-44b3-86be-277da7892b4a for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:09:12.005901 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Updating router abf03e4b-fdd0-44b3-86be-277da7892b4a port d5daee11-02d5-400a-872b-52ebf2382ec6 binding host dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:09:12.044584 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.066075 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.110193 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.194646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:12.213413 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:security_group_rule and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:12.228877 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:12.237876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:12.300807 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 8624cb8b-76b9-4f90-a661-444f15de47ab triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:12.301362 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.303469 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e58ac902-fcfc-4ddd-84cf-0fb1c939ed95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.330646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:12.343170 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.356392 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e58ac902-fcfc-4ddd-84cf-0fb1c939ed95 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b353ce9-2e68-4d5d-817c-368eccc7deb7,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:12.381772 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e58ac902-fcfc-4ddd-84cf-0fb1c939ed95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:12.388905 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.400012 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e58ac902-fcfc-4ddd-84cf-0fb1c939ed95 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.403781 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-e58ac902-fcfc-4ddd-84cf-0fb1c939ed95 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/8b353ce9-2e68-4d5d-817c-368eccc7deb7 HTTP/1.1" status: 204  len: 168 time: 1.0306170
Jun 01 11:09:12.412182 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b1591306-0918-40cf-a0e3-16f337c04d7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:12.438755 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Transition to ACTIVE for port object edb1a8b5-7020-4904-83c6-aafe25fb115f will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:12.454145 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Set router 51d6b52d-91aa-469c-9023-bb7143053ec7 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:12.467976 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.476505 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e00fe13-9d46-4ae0-977a-0696c212e28b,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:12.481268 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.510339 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:12.519201 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:12.525809 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 684}  {{(pid=119240) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:09:12.539511 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.544065 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 1.0099456
Jun 01 11:09:12.546340 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57304) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:12.563482 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'security_group_rule': {'security_group_id': 'cec527c5-3f99-4b4b-9bff-bd673a842279', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:12.582128 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.582470 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.segments_db [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Added segment ccc08e15-4be3-43c4-9ac7-4594ff6578f9 of type vlan for network 83595802-72ca-4498-b469-013b1defbf13
Jun 01 11:09:12.589872 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:12.603108 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.611118 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:security_group_rule and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:12.634161 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:12.691309 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:12.717629 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.743988 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cec527c5-3f99-4b4b-9bff-bd673a842279,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:12.746949 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:12.767841 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:12.810304 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Notify callbacks [] for port, precommit_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.832154 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.857066 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.provisioning_blocks [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Transition to ACTIVE for port object d5daee11-02d5-400a-872b-52ebf2382ec6 will not be triggered until provisioned by entity L2. {{(pid=119243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:12.872879 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:12.894033 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-190a8c27-387d-4687-bad9-854939887098 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:12.928753 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:13.004832 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:13.021481 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:13.022062 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:13.106176 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:13.159259 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd466790-7bf7-4504-9426-14c8af5a0d00 req-5de48c31-b194-48ed-b31c-68ca46f931e2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:13.162866 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fd466790-7bf7-4504-9426-14c8af5a0d00 req-5de48c31-b194-48ed-b31c-68ca46f931e2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 943 time: 0.5552444
Jun 01 11:09:13.175377 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 897 time: 1.8656864
Jun 01 11:09:13.178841 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57320) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:13.215896 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0ab14e77-7bf7-4d8f-8d58-73d5966cdf78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:13.219852 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-0ab14e77-7bf7-4d8f-8d58-73d5966cdf78 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=4244194d-2962-4661-95dd-d3f879a92c43 HTTP/1.1" status: 200  len: 851 time: 0.4559243
Jun 01 11:09:13.292431 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Request body: {'subnet': {'network_id': '83595802-72ca-4498-b469-013b1defbf13', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-553156585-subnet', 'tenant_id': 'e7a1c67b334348f6bb68128495ee8603', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:13.303259 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:13.316736 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Usage tracker for resource:subnet and tenant:e7a1c67b334348f6bb68128495ee8603 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:13.322031 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:13.336911 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:13.403960 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2776f7b-6c22-46fd-9897-b39252029ac1 None None] Pushing event updated for resources: {'Port': ['ID=d5daee11-02d5-400a-872b-52ebf2382ec6,revision_number=3']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:13.421083 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-f2776f7b-6c22-46fd-9897-b39252029ac1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.527s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:13.443043 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Made reservation on behalf of e7a1c67b334348f6bb68128495ee8603 for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:09:13.455859 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Notify callbacks [] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:13.456291 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Attempting to bind port d5daee11-02d5-400a-872b-52ebf2382ec6 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:13.456884 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Attempting to bind port d5daee11-02d5-400a-872b-52ebf2382ec6 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:13.457476 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Attempting to bind port d5daee11-02d5-400a-872b-52ebf2382ec6 on network 418faffe-faca-4025-ab0f-56771435263e {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:13.460892 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Pushing event updated for resources: {'Network': ['ID=83595802-72ca-4498-b469-013b1defbf13,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:13.464947 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.359s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:13.471714 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 8, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:13.472278 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Checking segment: {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:13.472779 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:13.473290 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Bound using segment: {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:13.473888 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Bound port: d5daee11-02d5-400a-872b-52ebf2382ec6, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'}}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:13.474376 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:13.483626 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Allocated IP 172.27.3.155 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/65052034-264b-4147-924a-51fb4cb964c9) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:09:13.528048 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 83595802-72ca-4498-b469-013b1defbf13 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:09:13.594668 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] For port d5daee11-02d5-400a-872b-52ebf2382ec6, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:13.604734 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] For port d5daee11-02d5-400a-872b-52ebf2382ec6, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=d5daee11-02d5-400a-872b-52ebf2382ec6,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:13.613540 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:13.624515 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:13.682100 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:13.682777 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57982044c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:13.724178 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fd466790-7bf7-4504-9426-14c8af5a0d00 req-2281027b-3fbc-4688-9de0-59db2fd33062 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5329800
Jun 01 11:09:13.736809 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b60d5a82-b99e-4128-a16b-da4305259b9c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:13.738054 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b60d5a82-b99e-4128-a16b-da4305259b9c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Synchronizing usage tracker for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:network {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:13.743268 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:13.936094 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.028188 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.031767 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:14.041651 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.087659 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:14.090236 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a49f71c6-702f-471a-b111-1dba4d7f37a0 None None] Pushing event updated for resources: {'Port': ['ID=edb1a8b5-7020-4904-83c6-aafe25fb115f,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:14.094587 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a49f71c6-702f-471a-b111-1dba4d7f37a0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.471s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:14.124987 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:14.128502 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:14.129317 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2776f7b-6c22-46fd-9897-b39252029ac1 None None] Pushing event updated for resources: {'Port': ['ID=d5daee11-02d5-400a-872b-52ebf2382ec6,revision_number=4']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:14.133248 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:09:14.142633 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-f2776f7b-6c22-46fd-9897-b39252029ac1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.518s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:14.152000 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:14.183529 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=79e4a681-ef96-4218-944d-58f2cfabd7e0,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:14.191123 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'Port': ['ID=65052034-264b-4147-924a-51fb4cb964c9,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:14.196477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:14.206337 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:14.229141 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.250484 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-9b47ae6d-cb04-4614-93d8-aea0c8a88d87 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=16003d7c-7204-44bb-9e84-543e6390b879&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2131803
Jun 01 11:09:14.251369 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.255359 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 1.7080104
Jun 01 11:09:14.258986 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57360) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:14.265477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'security_group_rule': {'security_group_id': 'cec527c5-3f99-4b4b-9bff-bd673a842279', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:14.271651 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:14.276106 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:security_group_rule and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:14.280726 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:14.286772 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:14.353664 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Attempting to bind port edb1a8b5-7020-4904-83c6-aafe25fb115f on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:14.354053 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Attempting to bind port edb1a8b5-7020-4904-83c6-aafe25fb115f by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:14.354426 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Attempting to bind port edb1a8b5-7020-4904-83c6-aafe25fb115f on network ce8e721a-c529-4460-882f-9261a0c7ceed {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:14.355130 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.363334 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 8, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:14.363742 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Checking segment: {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:14.364200 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.364609 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Bound using segment: {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:14.365089 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Bound port: edb1a8b5-7020-4904-83c6-aafe25fb115f, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:14.365473 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.434965 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-f3ab4ebb-e48d-4aea-b47c-18bfb5619931 service neutron] 10.222.0.79 "GET /v2.0/networks/16003d7c-7204-44bb-9e84-543e6390b879?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1392937
Jun 01 11:09:14.435743 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b60d5a82-b99e-4128-a16b-da4305259b9c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Unset dirty status for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:network {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:14.437488 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b60d5a82-b99e-4128-a16b-da4305259b9c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 818 time: 1.0691290
Jun 01 11:09:14.507393 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579873ebe0>, [{'id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251'}], 'enable_snat': True}, 'gw_port_id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:06Z', 'revision_number': 4, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'gw_port': {'id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:6f:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:53Z', 'updated_at': '2021-06-01T11:09:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '797df9ad-f50f-4533-9c1f-65512bddf40a', 'name': '', 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'mac_address': 'fa:16:3e:fe:34:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '069e04dd-9d3b-4ce0-997c-7cfc632b4fe3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:03Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 2, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'subnets': [{'id': '069e04dd-9d3b-4ce0-997c-7cfc632b4fe3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:14.520941 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Checking router: 51d6b52d-91aa-469c-9023-bb7143053ec7 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:09:14.521562 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Updating router 51d6b52d-91aa-469c-9023-bb7143053ec7 port 797df9ad-f50f-4533-9c1f-65512bddf40a binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:09:14.536478 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.620031 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] For port edb1a8b5-7020-4904-83c6-aafe25fb115f, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:14.628770 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-e2a7be3b-2358-4e30-a45b-d7682eb6024b tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/quotas/aac1cb46a9b144f5a5fac5f5c98fed2b HTTP/1.1" status: 200  len: 375 time: 0.1818640
Jun 01 11:09:14.637258 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.642793 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] For port edb1a8b5-7020-4904-83c6-aafe25fb115f, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=edb1a8b5-7020-4904-83c6-aafe25fb115f,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:14.649082 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.659167 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:14.659706 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.667049 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.680432 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:14.735883 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57982044c0>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:13Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:14.748064 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3a6ed6b-cabb-4f26-9e70-3d10b8b55961 None None] The sync data for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi is: [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:13Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:09:14.834961 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'Port': ['ID=65052034-264b-4147-924a-51fb4cb964c9,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:14.845045 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:14.864413 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.881518 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-2c13132a-9656-4589-8fae-cacff2d20570 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Synchronizing usage tracker for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:14.905880 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:14.919630 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 3.0143373
Jun 01 11:09:15.018879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:15.053243 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:15.058051 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57982ae040>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:15.183999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:15.186848 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3df81f-afa8-4890-8d8a-1ab75120bebc req-7e256b18-0c7c-442e-95aa-1fed71fbe2b1 service neutron] 10.222.0.79 "GET /v2.0/networks/16003d7c-7204-44bb-9e84-543e6390b879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.7416041
Jun 01 11:09:15.209536 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-2c13132a-9656-4589-8fae-cacff2d20570 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Unset dirty status for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:15.211075 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-2c13132a-9656-4589-8fae-cacff2d20570 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&fields=id HTTP/1.1" status: 200  len: 255 time: 0.5606413
Jun 01 11:09:15.211687 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:15.234656 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:15.261727 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a49f71c6-702f-471a-b111-1dba4d7f37a0 None None] Pushing event updated for resources: {'Port': ['ID=edb1a8b5-7020-4904-83c6-aafe25fb115f,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:15.309058 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a49f71c6-702f-471a-b111-1dba4d7f37a0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.629s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:15.447971 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:15.494685 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Checking segment: {'id': 'ccc08e15-4be3-43c4-9ac7-4594ff6578f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '83595802-72ca-4498-b469-013b1defbf13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:15.501496 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Network hostable DHCP agents. Network: 83595802-72ca-4498-b469-013b1defbf13, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:09:15.552467 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:15.556766 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57396) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:15.556949 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 1.2967262
Jun 01 11:09:15.561610 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a81f34e1-a97f-41c8-ab07-ffd578d5156c,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:15.563528 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'floatingip': {'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:15.569906 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.335s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:15.573324 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:15.577461 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.276s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:15.592990 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:floatingip and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:15.606830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b88a58f4-e9e9-4c5d-b680-e9ebb96c944a req-3eba2ff3-ac46-4ea4-8663-8c8ea85c1083 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:15.608404 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b88a58f4-e9e9-4c5d-b680-e9ebb96c944a req-3eba2ff3-ac46-4ea4-8663-8c8ea85c1083 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 943 time: 0.6115546
Jun 01 11:09:15.610586 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cad59e53-ff76-443d-8995-bbb02fce820a,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:15.619191 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Network 83595802-72ca-4498-b469-013b1defbf13 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:09:15.624781 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:15.627429 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:15.632486 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:15.657008 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:15.794293 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:15.937473 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-e30b7f7e-7ccf-403f-a28e-567c905cd68a service neutron] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119241) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:09:15.938507 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-e30b7f7e-7ccf-403f-a28e-567c905cd68a service neutron] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3785939
Jun 01 11:09:15.944857 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-477739f3-ac91-4773-9f3c-1706ceca032f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:15.964009 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-477739f3-ac91-4773-9f3c-1706ceca032f service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=0575695b945b453b9737182f6235cbe5&device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 1096 time: 0.6592515
Jun 01 11:09:15.968521 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 83595802-72ca-4498-b469-013b1defbf13) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:15.997478 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:16.159533 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-791ec851-1e1e-4bee-8d36-af36c560c2f1 None None] Network 83595802-72ca-4498-b469-013b1defbf13 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:09:16.178935 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:16.179686 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:16.302362 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Allocated IP 172.27.3.86 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/bb53334f-4b00-4b6b-98b3-45d16f841218) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:09:16.318115 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b88a58f4-e9e9-4c5d-b680-e9ebb96c944a req-9594c636-a28b-4149-b58e-cfd2b67540b4 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6949506
Jun 01 11:09:16.345586 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-b4c4e6de-a26c-4fde-aeb7-4b9b6ba851f1 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 3.1555517
Jun 01 11:09:16.428384 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device d5daee11-02d5-400a-872b-52ebf2382ec6 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:16.449809 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-2dd15b4c-dc8a-416b-8364-2f8a25736911 service neutron] 10.222.0.74 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4760008
Jun 01 11:09:16.510395 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-6b793639-477e-4b52-951f-cb57bbd2cb96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:16.511870 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-6b793639-477e-4b52-951f-cb57bbd2cb96 service neutron] 10.222.0.79 "GET /v2.0/networks?id=16003d7c-7204-44bb-9e84-543e6390b879 HTTP/1.1" status: 200  len: 912 time: 0.5470469
Jun 01 11:09:16.590477 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57436) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:16.665837 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:16.673849 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port d5daee11-02d5-400a-872b-52ebf2382ec6 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:16.685839 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port d5daee11-02d5-400a-872b-52ebf2382ec6 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:16.686771 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:16.699801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-c7feaa53-08b8-49b8-a32a-9f12da26574d admin admin] Deleting subnet 44efc8dd-3e88-44e1-a35d-8a10bcee9867 {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:09:16.704560 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c7feaa53-08b8-49b8-a32a-9f12da26574d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:16.721451 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-48d97d13-838c-4e97-8998-01b3b28d26b9 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c568e1a6-7392-470c-80fa-8943b8cc84b5 HTTP/1.1" status: 200  len: 217 time: 0.1509554
Jun 01 11:09:16.765921 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.db.resource_extend [None req-12788412-9da0-4863-b302-ad975416d5ff None None] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 11:09:16.768358 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c7feaa53-08b8-49b8-a32a-9f12da26574d admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:16.778717 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c7feaa53-08b8-49b8-a32a-9f12da26574d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:16.820442 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:16.829101 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:16.888737 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9b1b068f-4771-4829-8a29-c98bf1f46d26 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Synchronizing usage tracker for tenant:c004520781bb4854b87284b73cc2a8be on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:16.947547 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-b43e2fe6-eb3c-42da-a004-7b1e36de0d31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:16.949154 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-b43e2fe6-eb3c-42da-a004-7b1e36de0d31 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=4244194d-2962-4661-95dd-d3f879a92c43 HTTP/1.1" status: 200  len: 851 time: 0.1663787
Jun 01 11:09:16.990379 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'Port': ['ID=bb53334f-4b00-4b6b-98b3-45d16f841218,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:16.991886 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57982ae040>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:14Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:16.993785 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:17.016785 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:17.021102 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:17.022448 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a87078c8-f1d8-43b9-b064-ff945139e8de None None] Network 83595802-72ca-4498-b469-013b1defbf13 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:09:17.023572 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:09:17.042104 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:17.044907 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d2d99be-c5db-4b13-a9e5-278179692acd None None] The sync data for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi is: [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:14Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:09:17.056089 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:17.061842 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9b1b068f-4771-4829-8a29-c98bf1f46d26 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Unset dirty status for tenant:c004520781bb4854b87284b73cc2a8be on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:17.072168 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9b1b068f-4771-4829-8a29-c98bf1f46d26 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-securitygroup--310374559&fields=id&tenant_id=c004520781bb4854b87284b73cc2a8be HTTP/1.1" status: 200  len: 267 time: 0.5708067
Jun 01 11:09:17.188305 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Transition to ACTIVE for port object 797df9ad-f50f-4533-9c1f-65512bddf40a will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:17.190817 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:17.219170 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:17.224656 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-4b16060e-da5d-4609-be98-b22a0e7b36fe service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=16003d7c-7204-44bb-9e84-543e6390b879&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2670236
Jun 01 11:09:17.274030 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:17.290182 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-416be2c1-38f2-44eb-94c5-eaa71b0ecf8c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:17.296494 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-20ba7341-2b69-4723-a572-154fb28312c3 service neutron] 10.222.0.74 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8396742
Jun 01 11:09:17.613841 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-6d1e5a4a-73d6-467f-befa-bb02b7f07fe0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:17.614993 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-6d1e5a4a-73d6-467f-befa-bb02b7f07fe0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Synchronizing usage tracker for tenant:c004520781bb4854b87284b73cc2a8be on resource:network {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:17.646223 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-737411eb-a8b9-4bb0-b9e3-8fff164c4794 service neutron] 10.222.0.79 "GET /v2.0/networks/16003d7c-7204-44bb-9e84-543e6390b879?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3524132
Jun 01 11:09:17.806765 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port d5daee11-02d5-400a-872b-52ebf2382ec6, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=d5daee11-02d5-400a-872b-52ebf2382ec6,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:17.856358 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d9a2bc-22d7-42ec-99f1-97545be6289e None None] Pushing event updated for resources: {'Port': ['ID=797df9ad-f50f-4533-9c1f-65512bddf40a,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:17.860034 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-92d9a2bc-22d7-42ec-99f1-97545be6289e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.570s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:17.867599 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:17.936697 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:17.956946 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-6d1e5a4a-73d6-467f-befa-bb02b7f07fe0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Unset dirty status for tenant:c004520781bb4854b87284b73cc2a8be on resource:network {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:17.961202 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-6d1e5a4a-73d6-467f-befa-bb02b7f07fe0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 816 time: 0.8879876
Jun 01 11:09:18.104074 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.108682 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c7feaa53-08b8-49b8-a32a-9f12da26574d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.127987 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-cfd4a373-ee25-40ce-9e28-1234cf49d703 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:18.147420 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-47d4c7e8-6817-4b9e-93a5-3455f0d34f19 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/quotas/c004520781bb4854b87284b73cc2a8be HTTP/1.1" status: 200  len: 375 time: 0.1091540
Jun 01 11:09:18.221122 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7feaa53-08b8-49b8-a32a-9f12da26574d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=44efc8dd-3e88-44e1-a35d-8a10bcee9867,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:18.226985 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-c7feaa53-08b8-49b8-a32a-9f12da26574d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:18.230337 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.270213 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c7feaa53-08b8-49b8-a32a-9f12da26574d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.278475 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:18.308152 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device edb1a8b5-7020-4904-83c6-aafe25fb115f up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:18.364743 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Attempting to bind port 797df9ad-f50f-4533-9c1f-65512bddf40a on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:18.365127 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Attempting to bind port 797df9ad-f50f-4533-9c1f-65512bddf40a by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:18.365505 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Attempting to bind port 797df9ad-f50f-4533-9c1f-65512bddf40a on network e8c7dea7-722b-446b-9e9f-d27643e48187 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:18.392676 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 8, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:18.393115 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Checking segment: {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:18.393567 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.393971 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Bound using segment: {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:18.394543 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Bound port: 797df9ad-f50f-4533-9c1f-65512bddf40a, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:18.394933 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.424383 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=d5daee11-02d5-400a-872b-52ebf2382ec6,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:18.435943 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.502s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:18.470053 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.473912 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc0b117-8639-4dad-a894-830c640e352a req-c2625f77-02a3-4306-9040-e40ac946c524 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:18.485801 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-c7feaa53-08b8-49b8-a32a-9f12da26574d admin admin] 10.222.0.74 "DELETE /v2.0/subnets/44efc8dd-3e88-44e1-a35d-8a10bcee9867 HTTP/1.1" status: 204  len: 168 time: 1.8942618
Jun 01 11:09:18.488007 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3fc0b117-8639-4dad-a894-830c640e352a req-c2625f77-02a3-4306-9040-e40ac946c524 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 943 time: 0.5468073
Jun 01 11:09:18.491021 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57498) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:18.546733 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port edb1a8b5-7020-4904-83c6-aafe25fb115f completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:18.550971 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f7da28de-60f3-4f34-a2c7-830e37f8b1b0 req-21fb2475-9dd5-4942-8e25-3035b27c1700 service neutron] 10.222.0.79 "GET /v2.0/networks/16003d7c-7204-44bb-9e84-543e6390b879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8959811
Jun 01 11:09:18.558821 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port edb1a8b5-7020-4904-83c6-aafe25fb115f triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:18.559316 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.609177 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] For port 797df9ad-f50f-4533-9c1f-65512bddf40a, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:18.632002 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] For port 797df9ad-f50f-4533-9c1f-65512bddf40a, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=797df9ad-f50f-4533-9c1f-65512bddf40a,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:18.646598 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.650635 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3fc0b117-8639-4dad-a894-830c640e352a req-eede6294-da61-404f-9343-2d286ca51017 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1604903
Jun 01 11:09:18.657073 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-416be2c1-38f2-44eb-94c5-eaa71b0ecf8c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:18.682637 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-d1f6ff23-768d-401f-ba40-612298bd88ba tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&fields=id HTTP/1.1" status: 200  len: 348 time: 0.5286543
Jun 01 11:09:18.776699 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'Port': ['ID=bb53334f-4b00-4b6b-98b3-45d16f841218,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:18.793051 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.514s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:18.807015 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.817214 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 3.2588806
Jun 01 11:09:18.824809 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Routers {'51d6b52d-91aa-469c-9023-bb7143053ec7'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:18.825758 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579873ebe0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:08:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['51d6b52d-91aa-469c-9023-bb7143053ec7'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:18.899870 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:18.934217 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d9a2bc-22d7-42ec-99f1-97545be6289e None None] Pushing event updated for resources: {'Port': ['ID=797df9ad-f50f-4533-9c1f-65512bddf40a,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:18.945650 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-92d9a2bc-22d7-42ec-99f1-97545be6289e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:18.957323 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ea2b22f3-d4e0-4127-8a9e-026a169b3b35 req-f49d671c-ede8-4753-a1b5-ac91c9c07491 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0913620
Jun 01 11:09:19.031916 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:19.044365 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-5a7408b9-6ab4-4419-9803-46a060fbc602 service neutron] 10.222.0.74 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3349931
Jun 01 11:09:19.277499 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:19.287953 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port edb1a8b5-7020-4904-83c6-aafe25fb115f, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=edb1a8b5-7020-4904-83c6-aafe25fb115f,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:19.294333 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f579382c8b0>> segment before_delete 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.294333 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f579382c8b0>> subnet precommit_delete_associations 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.294596 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f579382c700>> segment_host_mapping after_create 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.294933 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f579382c700>> port after_create 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.295273 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f579382c700>> port after_delete 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.296387 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f579382c700>> port after_update 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.296704 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f579382c700>> segment after_delete 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.297025 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f579382c700>> subnet after_create 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.297344 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f579382c700>> subnet after_delete 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.297926 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f579382c700>> subnet after_update 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.303275 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] Set router 51d6b52d-91aa-469c-9023-bb7143053ec7 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:19.384410 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:19.397637 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-93254aa2-cb4d-442f-b58b-c1b21a2cc04e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:19.455338 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-b31e07fd-ff31-412d-b2a1-448cdf08f93b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Synchronizing usage tracker for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:19.487813 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-d54ddb06-ec84-4b29-bed3-18857f937b47 service neutron] 10.222.0.74 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4370337
Jun 01 11:09:19.490233 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-b31e07fd-ff31-412d-b2a1-448cdf08f93b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Unset dirty status for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:19.491495 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-b31e07fd-ff31-412d-b2a1-448cdf08f93b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-securitygroup--1731120544&fields=id&tenant_id=22a029b4c9f84f4191259891ac3af6c3 HTTP/1.1" status: 200  len: 267 time: 0.1130798
Jun 01 11:09:19.594988 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f57936fe040>> subnet after_create 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.595662 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f57936fe040>> subnet after_delete 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.596240 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f57936fe040>> subnet before_create 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.596859 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f57936fe040>> subnet before_update 55550000 {{(pid=119240) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:19.597517 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f579382c460>,) {'filters': {'network_id': ['3a3df211-07f0-4913-a977-3d2916782078']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:19.610301 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57544) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:19.624703 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f579382c460>, 'c863fd7d-d33b-435e-bd84-4d5c578be46f') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:19.625290 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f579382c460>, 'c863fd7d-d33b-435e-bd84-4d5c578be46f') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:19.641688 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:19.682177 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:19.697307 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=edb1a8b5-7020-4904-83c6-aafe25fb115f,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:19.709899 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Releasing vlan 665 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:09:19.711433 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:19.717282 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-e202e59b-4556-4184-85bf-6267f99d4153 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:19.718473 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-e202e59b-4556-4184-85bf-6267f99d4153 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Synchronizing usage tracker for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:network {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:19.725030 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.327s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:19.740569 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-e202e59b-4556-4184-85bf-6267f99d4153 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Unset dirty status for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:network {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:19.742212 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-e202e59b-4556-4184-85bf-6267f99d4153 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 810 time: 0.2427452
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   from cryptography.utils import int_from_bytes
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   from cryptography.utils import int_from_bytes
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:09:19.748587 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:09:19.771823 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-fa7c00c8-3bb2-4906-9da2-8fa4b6f6be40 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/quotas/22a029b4c9f84f4191259891ac3af6c3 HTTP/1.1" status: 200  len: 375 time: 0.0221307
Jun 01 11:09:19.858067 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:19.875717 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:19.879555 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Usage tracker for resource:security_group_rule and tenant:a825ca4347ae46a6ba7610504fb4f8b8 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:19.882423 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:19.889966 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:19.917546 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-12788412-9da0-4863-b302-ad975416d5ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579873ebe0>, [{'id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251'}], 'enable_snat': True}, 'gw_port_id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:06Z', 'revision_number': 4, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'gw_port': {'id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:6f:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:53Z', 'updated_at': '2021-06-01T11:09:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '797df9ad-f50f-4533-9c1f-65512bddf40a', 'name': '', 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'mac_address': 'fa:16:3e:fe:34:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '069e04dd-9d3b-4ce0-997c-7cfc632b4fe3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:03Z', 'updated_at': '2021-06-01T11:09:18Z', 'revision_number': 4, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'subnets': [{'id': '069e04dd-9d3b-4ce0-997c-7cfc632b4fe3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:19.921975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12788412-9da0-4863-b302-ad975416d5ff None None] The sync data for ids ['51d6b52d-91aa-469c-9023-bb7143053ec7'] in dv-cinder-787764-3-iscsi is: [{'id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251'}], 'enable_snat': True}, 'gw_port_id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:06Z', 'revision_number': 4, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'gw_port': {'id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:6f:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:53Z', 'updated_at': '2021-06-01T11:09:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '797df9ad-f50f-4533-9c1f-65512bddf40a', 'name': '', 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'mac_address': 'fa:16:3e:fe:34:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '069e04dd-9d3b-4ce0-997c-7cfc632b4fe3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:03Z', 'updated_at': '2021-06-01T11:09:18Z', 'revision_number': 4, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'subnets': [{'id': '069e04dd-9d3b-4ce0-997c-7cfc632b4fe3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:09:19.935629 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:19.944503 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:19.959808 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:19.999180 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] 10.222.0.74 "DELETE /v2.0/networks/3a3df211-07f0-4913-a977-3d2916782078 HTTP/1.1" status: 204  len: 168 time: 1.4966166
Jun 01 11:09:20.000297 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57568) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:20.017643 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Pushing event deleted for resources: {'Network': ['ID=3a3df211-07f0-4913-a977-3d2916782078,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:20.020373 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:20.058384 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-5542074e-011c-4c54-97e0-20a947039122 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2820182
Jun 01 11:09:20.065978 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-560b4d3c-8cbb-419e-9ccd-2dc4b4807ad2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:20.067504 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-560b4d3c-8cbb-419e-9ccd-2dc4b4807ad2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 818 time: 0.2294517
Jun 01 11:09:20.133760 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-91ff74fb-836a-441d-8e2a-5413aaef97ad tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/quotas/aac1cb46a9b144f5a5fac5f5c98fed2b HTTP/1.1" status: 200  len: 375 time: 0.0319924
Jun 01 11:09:20.145679 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] Deleting subnet a81f34e1-a97f-41c8-ab07-ffd578d5156c {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:09:20.151713 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.187013 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.205450 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.259052 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:20.298100 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10700501'] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.319472 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-b42d5e59-baea-40a6-b069-f21b43e09e2e service neutron] 10.222.0.74 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2475512
Jun 01 11:09:20.328905 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=a825ca4347ae46a6ba7610504fb4f8b8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7171547
Jun 01 11:09:20.333984 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82c34f92-cb41-4fa0-9051-2d3d2dadcacc,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:20.338142 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57576) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:20.351290 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:20.369779 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-a8597184-bd4b-4f9f-a1bf-1b3bc6e079f5 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1788416
Jun 01 11:09:20.413995 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device d5daee11-02d5-400a-872b-52ebf2382ec6 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:20.442919 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.517252 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port d5daee11-02d5-400a-872b-52ebf2382ec6 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:20.517792 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.531184 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0a0962a6-0134-4f38-801e-0cf6a43524d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.562139 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0a0962a6-0134-4f38-801e-0cf6a43524d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.646533 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-3016d5b8-51fc-4e54-9da3-07a33af4d17e service neutron] 10.222.0.74 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3199277
Jun 01 11:09:20.656297 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-dcfe5ce6-7a87-4af3-85d3-9eedbbcca0f5 service neutron] 10.222.0.74 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2852755
Jun 01 11:09:20.751264 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 797df9ad-f50f-4533-9c1f-65512bddf40a up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:20.771263 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0a0962a6-0134-4f38-801e-0cf6a43524d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.785351 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:20.805128 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a0962a6-0134-4f38-801e-0cf6a43524d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82c34f92-cb41-4fa0-9051-2d3d2dadcacc,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:20.812794 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0a0962a6-0134-4f38-801e-0cf6a43524d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:20.815918 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0a0962a6-0134-4f38-801e-0cf6a43524d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.817446 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-0a0962a6-0134-4f38-801e-0cf6a43524d8 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/82c34f92-cb41-4fa0-9051-2d3d2dadcacc HTTP/1.1" status: 204  len: 168 time: 0.4781222
Jun 01 11:09:20.868437 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-712503d3-e51d-4be6-96b8-020e7c6474d6 service neutron] 10.222.0.74 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2109351
Jun 01 11:09:20.909237 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 797df9ad-f50f-4533-9c1f-65512bddf40a completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:20.914659 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 797df9ad-f50f-4533-9c1f-65512bddf40a triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:20.915124 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:20.995959 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a89dee1a-35dd-4478-b324-ce6501cad5c1 req-71ba7a9a-d302-4edb-8088-ec56d2a8259d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0624964
Jun 01 11:09:21.009129 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10700437', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-11313305'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:21.017682 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:21.058438 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a81f34e1-a97f-41c8-ab07-ffd578d5156c,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:21.062661 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:21.063914 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:21.079218 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/a81f34e1-a97f-41c8-ab07-ffd578d5156c HTTP/1.1" status: 204  len: 168 time: 1.0683076
Jun 01 11:09:21.081213 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57596) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:21.139775 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:21.216289 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 797df9ad-f50f-4533-9c1f-65512bddf40a, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=797df9ad-f50f-4533-9c1f-65512bddf40a,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:21.228738 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:21.230463 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device edb1a8b5-7020-4904-83c6-aafe25fb115f up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:21.297508 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a49f71c6-702f-471a-b111-1dba4d7f37a0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:21.303670 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c9097abe-9db1-4a0d-8229-e5d7290809d6 req-227d007d-aeca-4119-a8e8-9eed9968d4f7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 210 time: 0.0899985
Jun 01 11:09:21.408700 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=797df9ad-f50f-4533-9c1f-65512bddf40a,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:21.412581 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:21.419129 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port edb1a8b5-7020-4904-83c6-aafe25fb115f triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:21.419681 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:21.520459 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57614) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:21.551171 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:21.556064 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c568e1a6-7392-470c-80fa-8943b8cc84b5 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:09:21.613237 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:21.622909 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:21.625199 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Usage tracker for resource:security_group_rule and tenant:6c65a6ae18f54092a0e17cc0230c7c8c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:21.632561 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:21.635274 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-42e0ccf8-fdd1-41af-ad5c-c61c51799b00 req-5ba39aa4-79d1-495b-ac16-555ae504545d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.1655552
Jun 01 11:09:21.654122 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:21.767843 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.db.resource_extend [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 11:09:21.911750 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:21.930763 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:21.959486 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-45d4d9ed-b11a-4ee9-99ef-f0148a2ea704 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:21.965453 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c568e1a6-7392-470c-80fa-8943b8cc84b5, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c568e1a6-7392-470c-80fa-8943b8cc84b5,segment=NetworkSegment(989f88ce-9ed9-4d44-aabd-f14b3be6c3d4),segment_id=989f88ce-9ed9-4d44-aabd-f14b3be6c3d4)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:22.007923 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'c568e1a6-7392-470c-80fa-8943b8cc84b5', 'network_id': '16003d7c-7204-44bb-9e84-543e6390b879', 'port_id': 'c568e1a6-7392-470c-80fa-8943b8cc84b5', 'mac_address': 'fa:16:3e:11:17:22', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 660, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4244194d-2962-4661-95dd-d3f879a92c43', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:09:22.024396 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=453657b0-2f57-4db4-bcec-8bc64fab7366,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:22.052598 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:22.066322 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=6c65a6ae18f54092a0e17cc0230c7c8c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5438492
Jun 01 11:09:22.069088 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57636) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:22.116276 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc454283-00ea-4d64-9f83-bd7bbaa283bc req-3311884b-8d0c-4893-b102-fed433af7a9d tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:22.117720 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cc454283-00ea-4d64-9f83-bd7bbaa283bc req-3311884b-8d0c-4893-b102-fed433af7a9d tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 943 time: 0.8131692
Jun 01 11:09:22.130402 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.173189 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.192149 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bb15ec0c-b70c-442c-b065-8ed4bacaa4ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.197407 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c568e1a6-7392-470c-80fa-8943b8cc84b5 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:22.219098 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c568e1a6-7392-470c-80fa-8943b8cc84b5, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c568e1a6-7392-470c-80fa-8943b8cc84b5,segment=NetworkSegment(989f88ce-9ed9-4d44-aabd-f14b3be6c3d4),segment_id=989f88ce-9ed9-4d44-aabd-f14b3be6c3d4)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:22.224253 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 797df9ad-f50f-4533-9c1f-65512bddf40a up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:22.229831 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bb15ec0c-b70c-442c-b065-8ed4bacaa4ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.235049 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ede33cae-eafe-40f5-8cb0-125ca5d334d2 req-89edc915-f4d4-42aa-9ba3-3c73912fecd2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0697854
Jun 01 11:09:22.237343 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f5793e1dd30>> segment before_delete 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.237680 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f5793e1dd30>> subnet precommit_delete_associations 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.243610 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f5793d65f10>> segment_host_mapping after_create 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.244041 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f5793d65f10>> port after_create 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.244374 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f5793d65f10>> port after_delete 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.244734 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f5793d65f10>> port after_update 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.245053 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f5793d65f10>> segment after_delete 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.245377 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f5793d65f10>> subnet after_create 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.245692 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f5793d65f10>> subnet after_delete 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.246017 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f5793d65f10>> subnet after_update 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.256561 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.259129 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:22.296965 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bb15ec0c-b70c-442c-b065-8ed4bacaa4ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.302104 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:22.313855 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb15ec0c-b70c-442c-b065-8ed4bacaa4ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=453657b0-2f57-4db4-bcec-8bc64fab7366,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:22.316741 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-bb15ec0c-b70c-442c-b065-8ed4bacaa4ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:22.319821 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bb15ec0c-b70c-442c-b065-8ed4bacaa4ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.321344 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-bb15ec0c-b70c-442c-b065-8ed4bacaa4ad admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/453657b0-2f57-4db4-bcec-8bc64fab7366 HTTP/1.1" status: 204  len: 168 time: 0.2495353
Jun 01 11:09:22.328202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f57938475b0>> subnet after_create 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.328546 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f57938475b0>> subnet after_delete 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.328873 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f57938475b0>> subnet before_create 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.329193 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f57938475b0>> subnet before_update 55550000 {{(pid=119241) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 11:09:22.329544 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f57981f68e0>,) {'filters': {'network_id': ['83595802-72ca-4498-b469-013b1defbf13']}} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:22.353006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f57981f68e0>, 'ccc08e15-4be3-43c4-9ac7-4594ff6578f9') {'for_net_delete': True} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:22.353295 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f57981f68e0>, 'ccc08e15-4be3-43c4-9ac7-4594ff6578f9') {} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:22.378955 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=c568e1a6-7392-470c-80fa-8943b8cc84b5,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:22.383401 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:22.392491 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10844038'] for segment, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.402995 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cc454283-00ea-4d64-9f83-bd7bbaa283bc req-e0ebcfc8-6a47-4505-a5a4-b57f3f7f4de3 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2758586
Jun 01 11:09:22.412423 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 797df9ad-f50f-4533-9c1f-65512bddf40a triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:22.417055 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.418787 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.426348 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Releasing vlan 684 on physical network physnet1 to pool {{(pid=119241) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:09:22.426913 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10959794'] for segment, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   from cryptography.utils import int_from_bytes
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   from cryptography.utils import int_from_bytes
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]: Traceback (most recent call last):
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     timer()
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     cb(*args, **kw)
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     return func(*args, **kwargs)
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     self._notify()
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     self.callback(batched_events)
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     event.method(event)
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     return f(self, *a, **k)
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._get(url).json()
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:09:22.444281 dv-cinder-787764-3-iscsi neutron-server[119241]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:09:22.537984 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a62c97f9-c38a-4cb5-aced-b6e7f5e813b5 req-ee86a91b-9b12-4c3f-b239-cb16ca3a3261 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 210 time: 0.0928042
Jun 01 11:09:22.577042 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.581817 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:22.599630 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.605495 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Pushing event deleted for resources: {'Network': ['ID=83595802-72ca-4498-b469-013b1defbf13,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:22.607867 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:22.612189 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] 10.222.0.74 "DELETE /v2.0/networks/83595802-72ca-4498-b469-013b1defbf13 HTTP/1.1" status: 204  len: 168 time: 1.5299969
Jun 01 11:09:22.712109 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6c65830b-6313-41aa-ac4f-63de74f62c57 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.819036 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 57662) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:22.831883 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fc85722a-7265-4e14-9a64-31c5f6b15d96 req-cddc394b-8dab-44a3-912b-098ea9e06167 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.0523880
Jun 01 11:09:22.874796 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e1c0d627-174d-43b0-9135-2d8f0ba789c3 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=53787281a5064c3fb8b987f0ad26c87d&name=default HTTP/1.1" status: 200  len: 2977 time: 0.0533061
Jun 01 11:09:22.878401 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57668) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:22.943398 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2ae8c21-c3aa-427b-ba89-2d1b08d6a424 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:22.972927 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2ae8c21-c3aa-427b-ba89-2d1b08d6a424 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:23.028357 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2ae8c21-c3aa-427b-ba89-2d1b08d6a424 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:23.032608 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:23.044741 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ae8c21-c3aa-427b-ba89-2d1b08d6a424 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4009dde3-16ab-4f86-8215-85d0ebbba364,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:23.052158 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e2ae8c21-c3aa-427b-ba89-2d1b08d6a424 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:23.052980 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e2ae8c21-c3aa-427b-ba89-2d1b08d6a424 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:23.054109 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-e2ae8c21-c3aa-427b-ba89-2d1b08d6a424 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/4009dde3-16ab-4f86-8215-85d0ebbba364 HTTP/1.1" status: 204  len: 168 time: 0.1746852
Jun 01 11:09:23.405963 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3ba740f5-67d9-4fb5-9faa-b861e7e46467 req-1db856c6-c741-445b-b7ee-0c54f347d90a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0494525
Jun 01 11:09:23.439397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57696) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:23.491702 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f08bedcd-3447-4623-b83c-7bb4a2aabba9 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=e7a1c67b334348f6bb68128495ee8603&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0488095
Jun 01 11:09:23.491931 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 57700) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:23.605520 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c1630ac4-40fc-45d4-8dc4-1dd5909ecf1f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:23.640371 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c1630ac4-40fc-45d4-8dc4-1dd5909ecf1f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:23.701347 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-011aed97-4533-4600-8beb-71d098a486ee req-5c3ce2a6-2854-4385-85d1-efcc25760694 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 210 time: 0.0538425
Jun 01 11:09:23.724295 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc81812b-7a9c-4a9e-ae28-1264a5c2579b req-1a127734-25fa-43a5-8384-cf5d1e29649a tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:23.726008 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fc81812b-7a9c-4a9e-ae28-1264a5c2579b req-1a127734-25fa-43a5-8384-cf5d1e29649a tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 944 time: 0.1941831
Jun 01 11:09:23.784828 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fc81812b-7a9c-4a9e-ae28-1264a5c2579b req-505eceef-b79e-4075-b62a-961ac74e33f2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421288
Jun 01 11:09:23.785647 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c1630ac4-40fc-45d4-8dc4-1dd5909ecf1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:23.791007 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-19fe6bad-9b3c-4c41-9da6-4640ba1cbb14 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:23.810289 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1630ac4-40fc-45d4-8dc4-1dd5909ecf1f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e00fe13-9d46-4ae0-977a-0696c212e28b,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:23.813271 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c1630ac4-40fc-45d4-8dc4-1dd5909ecf1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:23.814983 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c1630ac4-40fc-45d4-8dc4-1dd5909ecf1f admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:23.816827 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c1630ac4-40fc-45d4-8dc4-1dd5909ecf1f admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/2e00fe13-9d46-4ae0-977a-0696c212e28b HTTP/1.1" status: 204  len: 168 time: 0.3239903
Jun 01 11:09:23.983707 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9c946097-9de4-4740-a4bd-af561f739f46 req-4f0f4f94-645a-437e-b85b-7f2939c4b1de tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.0456896
Jun 01 11:09:24.556305 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ed0e253c-fcb3-44c9-ab4b-b68533d0091e req-a37e5ffc-6f66-47ae-9102-597edd240616 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0409033
Jun 01 11:09:24.862286 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5de1a7f4-1fae-49a1-bf8d-7bdf910d859f req-2d30d278-a39d-4f38-b972-18afc143cb70 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 210 time: 0.0482764
Jun 01 11:09:25.074121 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1524a5c5-eace-4eb0-a0cd-d667050d9636 req-718ef28b-2e9d-47b9-b493-93ab9210344d tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:25.076010 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1524a5c5-eace-4eb0-a0cd-d667050d9636 req-718ef28b-2e9d-47b9-b493-93ab9210344d tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 944 time: 0.1227627
Jun 01 11:09:25.131050 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1524a5c5-eace-4eb0-a0cd-d667050d9636 req-290cb0b7-1164-4281-a68f-ba6d90498773 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425022
Jun 01 11:09:25.193828 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8d265162-cb73-45fc-9222-2146a0f38a9e req-f5ade8dc-ed32-4dc4-b234-0bb4fe375bed tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.0471632
Jun 01 11:09:25.231828 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['c568e1a6-7392-470c-80fa-8943b8cc84b5'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:09:25.275405 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-cce1a5e6-c0f3-4ad1-8c40-7669fab38397 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:25.307876 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:25.626581 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-8cfc4e49-ce4f-4b6e-bb2b-9de74349ae51 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:25.628146 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-8cfc4e49-ce4f-4b6e-bb2b-9de74349ae51 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 810 time: 0.1702137
Jun 01 11:09:25.773603 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-45182b52-f19e-4594-98a5-db7793380c2d tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=22a029b4c9f84f4191259891ac3af6c3 HTTP/1.1" status: 200  len: 380 time: 0.1291716
Jun 01 11:09:25.776333 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c4e1ad0f-ff7b-482f-b638-6e00c81c6025 req-1f328844-cdd7-47af-b259-da6cd2c365a8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0649633
Jun 01 11:09:25.789814 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'port': {'device_id': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'admin_state_up': True, 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'security_groups': ['cec527c5-3f99-4b4b-9bff-bd673a842279']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:25.981806 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.79', 58739) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:26.054497 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:26.069336 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:port and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:26.074039 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-724498c2-8ff7-42e4-af42-870ed6519803 req-6d83698c-2ca7-4922-8322-a5ded9bd1a10 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 210 time: 0.0702810
Jun 01 11:09:26.074835 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for port was recalculated. Used quota:3. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:26.081817 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:26.095044 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Made reservation on behalf of 22a029b4c9f84f4191259891ac3af6c3 for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:09:26.098961 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:26.315775 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-4c222acd-7554-40dc-a51f-0ec2a6b6b86d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:26.318180 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-4c222acd-7554-40dc-a51f-0ec2a6b6b86d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.79 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 818 time: 0.3346107
Jun 01 11:09:26.357184 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Request body: {'port': {'device_id': '2ae35c17-2544-4168-bce0-4d60d97a1698', 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187', 'admin_state_up': True, 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:26.367693 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:26.535795 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a1dba9c6-1471-46ba-ab57-66cef9ca6b2f req-58825b50-755f-44aa-b0dd-a3efc254c01e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.1425819
Jun 01 11:09:26.541578 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:26.565169 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:26.596404 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Made reservation on behalf of aac1cb46a9b144f5a5fac5f5c98fed2b for: {'port': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:09:26.603578 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:26.646230 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac52159-4351-4b4f-85a5-42209054cced req-28b6b781-8b16-45ff-8d9c-df6bcfd2b892 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:26.653935 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cac52159-4351-4b4f-85a5-42209054cced req-28b6b781-8b16-45ff-8d9c-df6bcfd2b892 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 944 time: 0.3608286
Jun 01 11:09:26.658483 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Allocated IP 172.20.0.6 (418faffe-faca-4025-ab0f-56771435263e/08c4a15d-0d06-4d4b-909f-10ac28c5c16c/c4a9498c-cfd5-4c11-ba25-e4985d580263) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:09:26.723896 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cac52159-4351-4b4f-85a5-42209054cced req-56022222-8b41-40cc-923a-c37801200c18 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0689628
Jun 01 11:09:26.811577 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Allocated IP 172.20.0.13 (e8c7dea7-722b-446b-9e9f-d27643e48187/069e04dd-9d3b-4ce0-997c-7cfc632b4fe3/b697fc18-c717-4cd5-a5ec-3378e1131e24) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:09:26.984691 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.056292 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-78b0dc9a-f22b-49e6-841d-ea9dc6c657d4 req-9da25cf2-3282-4799-b8b4-e23cb1bd199c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0505197
Jun 01 11:09:27.068151 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Transition to ACTIVE for port object c4a9498c-cfd5-4c11-ba25-e4985d580263 will not be triggered until provisioned by entity DHCP. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:27.093969 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.101110 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:27.105274 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.143774 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.151929 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:27.174296 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Network 418faffe-faca-4025-ab0f-56771435263e is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:27.177644 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:27.181672 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:09:27.226741 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'Port': ['ID=c4a9498c-cfd5-4c11-ba25-e4985d580263,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:27.235934 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:27.278218 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Network e8c7dea7-722b-446b-9e9f-d27643e48187 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:27.283210 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:27.288113 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:09:27.309518 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:27.310151 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.324505 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c568e1a6-7392-470c-80fa-8943b8cc84b5 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:27.346156 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Pushing event updated for resources: {'Port': ['ID=b697fc18-c717-4cd5-a5ec-3378e1131e24,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:27.354722 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:27.362579 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.5810447
Jun 01 11:09:27.376964 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:27.377928 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.390615 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e32096-abdb-492e-a177-8b85019ebe4e req-aee68376-bfb9-489c-8dad-867e0c8093ea tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:27.391493 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-02e32096-abdb-492e-a177-8b85019ebe4e req-aee68376-bfb9-489c-8dad-867e0c8093ea tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Synchronizing usage tracker for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:27.411371 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0599625
Jun 01 11:09:27.417568 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-02e32096-abdb-492e-a177-8b85019ebe4e req-aee68376-bfb9-489c-8dad-867e0c8093ea tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Unset dirty status for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:27.419019 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-02e32096-abdb-492e-a177-8b85019ebe4e req-aee68376-bfb9-489c-8dad-867e0c8093ea tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 931 time: 0.1696372
Jun 01 11:09:27.448288 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port c568e1a6-7392-470c-80fa-8943b8cc84b5 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:27.454705 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port c568e1a6-7392-470c-80fa-8943b8cc84b5 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:27.455341 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.511794 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-02e32096-abdb-492e-a177-8b85019ebe4e req-b8242bd9-819a-4789-ae84-4f97c080352c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0852246
Jun 01 11:09:27.530836 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-0ed87bc0-717d-41be-991c-0be55217b1df None None] Provisioning for port c4a9498c-cfd5-4c11-ba25-e4985d580263 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:27.537904 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-0ed87bc0-717d-41be-991c-0be55217b1df None None] Provisioning complete for port c4a9498c-cfd5-4c11-ba25-e4985d580263 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:27.538286 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0ed87bc0-717d-41be-991c-0be55217b1df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.651798 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-0ed87bc0-717d-41be-991c-0be55217b1df None None] Port c4a9498c-cfd5-4c11-ba25-e4985d580263 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:09:27.663299 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.691179 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '30bbda88-b979-4b36-bafb-eb3ae5baa20b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c568e1a6-7392-470c-80fa-8943b8cc84b5'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:27.695398 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a9ff40b-99e9-41b1-8b37-3b35190dca72 req-eae680c2-6f56-4cf8-aeae-571243804997 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.0458264
Jun 01 11:09:27.768510 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c568e1a6-7392-470c-80fa-8943b8cc84b5, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c568e1a6-7392-470c-80fa-8943b8cc84b5,segment=NetworkSegment(989f88ce-9ed9-4d44-aabd-f14b3be6c3d4),segment_id=989f88ce-9ed9-4d44-aabd-f14b3be6c3d4)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:27.775283 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.777383 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:27.803974 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:09:27.815166 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:27.848284 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=c568e1a6-7392-470c-80fa-8943b8cc84b5,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:27.851395 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:27.881220 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d1f83eae-e1ce-4c35-8765-a656042a77d0" -d '{"events": [{"server_uuid": "30bbda88-b979-4b36-bafb-eb3ae5baa20b", "name": "network-vif-plugged", "status": "completed", "tag": "c568e1a6-7392-470c-80fa-8943b8cc84b5"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:27.939602 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6ca44d-5e01-48a7-949c-9dd7df9b5eb0 req-43c5edb8-622e-4a70-84cf-24b95473d9cf tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:27.941151 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fe6ca44d-5e01-48a7-949c-9dd7df9b5eb0 req-43c5edb8-622e-4a70-84cf-24b95473d9cf tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.0847399
Jun 01 11:09:27.977342 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81070e3e-654e-45d5-9c35-0b5983c4ee17 x-openstack-request-id: req-81070e3e-654e-45d5-9c35-0b5983c4ee17 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:27.977712 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "30bbda88-b979-4b36-bafb-eb3ae5baa20b", "name": "network-vif-plugged", "status": "completed", "tag": "c568e1a6-7392-470c-80fa-8943b8cc84b5", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:27.978047 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-81070e3e-654e-45d5-9c35-0b5983c4ee17 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:27.978580 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '30bbda88-b979-4b36-bafb-eb3ae5baa20b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c568e1a6-7392-470c-80fa-8943b8cc84b5', 'code': 200}
Jun 01 11:09:27.986932 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fe6ca44d-5e01-48a7-949c-9dd7df9b5eb0 req-6a2d0309-eb0c-463a-887c-cb10c4799976 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400996
Jun 01 11:09:28.228843 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0cc9be21-31bb-4cc6-b852-9e12d23e50ef req-7a8d1364-43a0-4fd4-858c-9c87a8256172 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0487847
Jun 01 11:09:28.684580 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3eb74b4-8a85-40de-98ef-3aee54924633 req-1b8354a8-b541-4ea9-80b0-453826a730d2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:28.686158 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b3eb74b4-8a85-40de-98ef-3aee54924633 req-1b8354a8-b541-4ea9-80b0-453826a730d2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 931 time: 0.0776002
Jun 01 11:09:28.738926 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b3eb74b4-8a85-40de-98ef-3aee54924633 req-9cfca181-497c-4228-877b-21da82c2d5f0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0449517
Jun 01 11:09:28.852635 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-81eef1da-d6d3-4765-aee9-49bf3650eeda req-15861961-fc2d-4024-bd7e-dc5c52ef3745 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.0420148
Jun 01 11:09:29.168954 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08cce310-d897-40ec-82f8-2a6641fb0928 req-1454d94c-92fd-4a28-9bb2-ad80911b8510 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:29.170396 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-08cce310-d897-40ec-82f8-2a6641fb0928 req-1454d94c-92fd-4a28-9bb2-ad80911b8510 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.0773649
Jun 01 11:09:29.217544 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-08cce310-d897-40ec-82f8-2a6641fb0928 req-66b0e257-3aa2-4b09-aeaa-47c59be73030 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416770
Jun 01 11:09:29.229908 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.79', 58742) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:29.299062 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Request body: {'port': {'device_id': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:29.352650 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Request body: {'port': {'device_id': '2ae35c17-2544-4168-bce0-4d60d97a1698', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:29.465789 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0483724e-73d2-4e37-94af-c30a33b9c674 req-e06286dd-70cc-4938-a00b-d6d2bc32d7f1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0851417
Jun 01 11:09:29.490919 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:29.526140 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-7e4cf348-b009-4659-82f7-c676493d4801 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:29.527553 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-7e4cf348-b009-4659-82f7-c676493d4801 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 816 time: 0.2797341
Jun 01 11:09:29.536127 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:29.641132 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-812949b6-d19f-4886-9dc1-cc8e3a6fb394 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Synchronizing usage tracker for tenant:c004520781bb4854b87284b73cc2a8be on resource:security_group {{(pid=119240) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:29.665797 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-812949b6-d19f-4886-9dc1-cc8e3a6fb394 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Unset dirty status for tenant:c004520781bb4854b87284b73cc2a8be on resource:security_group {{(pid=119240) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:29.667016 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-812949b6-d19f-4886-9dc1-cc8e3a6fb394 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c004520781bb4854b87284b73cc2a8be HTTP/1.1" status: 200  len: 379 time: 0.1179335
Jun 01 11:09:30.008643 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b697fc18-c717-4cd5-a5ec-3378e1131e24 {{(pid=119240) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:30.016596 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.031747 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Transition to ACTIVE for port object b697fc18-c717-4cd5-a5ec-3378e1131e24 will not be triggered until provisioned by entity L2. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:30.033517 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-39893cfb-428d-40a6-9ff9-0584e09ff15a req-fc25d560-506c-4399-9d7d-7cb3aa534c25 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.0611682
Jun 01 11:09:30.035570 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c4a9498c-cfd5-4c11-ba25-e4985d580263 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:30.036748 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.041552 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:30.047539 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.070112 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Transition to ACTIVE for port object c4a9498c-cfd5-4c11-ba25-e4985d580263 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:30.074140 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.080102 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:30.115069 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ff271f-02aa-453c-9c5d-3fafa87cea2f req-85364d4b-2296-4737-946d-67c3744c6fe6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:30.116548 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-50ff271f-02aa-453c-9c5d-3fafa87cea2f req-85364d4b-2296-4737-946d-67c3744c6fe6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 931 time: 0.1968594
Jun 01 11:09:30.209838 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Pushing event updated for resources: {'Port': ['ID=b697fc18-c717-4cd5-a5ec-3378e1131e24,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:30.219883 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:30.275076 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Pushing event updated for resources: {'Port': ['ID=c4a9498c-cfd5-4c11-ba25-e4985d580263,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:30.285663 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:30.296057 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Attempting to bind port b697fc18-c717-4cd5-a5ec-3378e1131e24 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:30.296619 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Attempting to bind port b697fc18-c717-4cd5-a5ec-3378e1131e24 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:30.296984 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Attempting to bind port b697fc18-c717-4cd5-a5ec-3378e1131e24 on network e8c7dea7-722b-446b-9e9f-d27643e48187 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:30.303739 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Port b697fc18-c717-4cd5-a5ec-3378e1131e24 on network e8c7dea7-722b-446b-9e9f-d27643e48187 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:09:30.304539 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Attempting to bind port b697fc18-c717-4cd5-a5ec-3378e1131e24 on network e8c7dea7-722b-446b-9e9f-d27643e48187 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:30.312119 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 9, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:30.312548 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Checking segment: {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:30.313147 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Bound using segment: {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:30.313694 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Bound port: b697fc18-c717-4cd5-a5ec-3378e1131e24, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'}}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:30.314236 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.325520 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-50ff271f-02aa-453c-9c5d-3fafa87cea2f req-f27e9dce-0dfb-4bbf-9cfe-28018df0e25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1999137
Jun 01 11:09:30.367722 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Attempting to bind port c4a9498c-cfd5-4c11-ba25-e4985d580263 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:30.368058 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Attempting to bind port c4a9498c-cfd5-4c11-ba25-e4985d580263 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:30.368382 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Attempting to bind port c4a9498c-cfd5-4c11-ba25-e4985d580263 on network 418faffe-faca-4025-ab0f-56771435263e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:30.375933 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Port c4a9498c-cfd5-4c11-ba25-e4985d580263 on network 418faffe-faca-4025-ab0f-56771435263e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:09:30.376283 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Attempting to bind port c4a9498c-cfd5-4c11-ba25-e4985d580263 on network 418faffe-faca-4025-ab0f-56771435263e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:30.383028 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 9, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:30.383361 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Checking segment: {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:30.383990 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Bound using segment: {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:30.384471 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Bound port: c4a9498c-cfd5-4c11-ba25-e4985d580263, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:30.384820 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.448613 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] For port b697fc18-c717-4cd5-a5ec-3378e1131e24, host hv-cinder-78776, cleared binding levels {{(pid=119240) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:30.454825 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] For port b697fc18-c717-4cd5-a5ec-3378e1131e24, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119240) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:30.460852 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.467082 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:30.545196 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:30.545839 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.547265 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] 10.222.0.79 "PUT /v2.0/ports/b697fc18-c717-4cd5-a5ec-3378e1131e24 HTTP/1.1" status: 200  len: 1094 time: 1.2045188
Jun 01 11:09:30.547766 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2ae35c17-2544-4168-bce0-4d60d97a1698', 'tag': 'b697fc18-c717-4cd5-a5ec-3378e1131e24'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:30.549238 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.79', 58747) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:30.578508 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-989cce5e-16e2-4767-b4bc-3b7747ae16e3 req-5481b27d-b399-4ca8-ac61-8c7cbbd2a31e tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:30.580180 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-989cce5e-16e2-4767-b4bc-3b7747ae16e3 req-5481b27d-b399-4ca8-ac61-8c7cbbd2a31e tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.1782892
Jun 01 11:09:30.581292 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] For port c4a9498c-cfd5-4c11-ba25-e4985d580263, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:30.584997 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] For port c4a9498c-cfd5-4c11-ba25-e4985d580263, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:30.598574 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Pushing event updated for resources: {'Port': ['ID=b697fc18-c717-4cd5-a5ec-3378e1131e24,revision_number=3']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:30.609254 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:30.616032 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.621355 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357" -d '{"events": [{"name": "network-changed", "server_uuid": "2ae35c17-2544-4168-bce0-4d60d97a1698", "tag": "b697fc18-c717-4cd5-a5ec-3378e1131e24"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:30.666134 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:30.714191 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1045e924-f210-493a-953c-48a15565ab90 req-40f31c8e-e4be-49b6-b62c-6d82c1e81fbf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.1019599
Jun 01 11:09:30.726787 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-989cce5e-16e2-4767-b4bc-3b7747ae16e3 req-bfa3496f-6deb-43a7-a58b-a685ea0153d4 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1403415
Jun 01 11:09:30.746460 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:30.747202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:30.749381 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] 10.222.0.79 "PUT /v2.0/ports/c4a9498c-cfd5-4c11-ba25-e4985d580263 HTTP/1.1" status: 200  len: 1093 time: 1.4550006
Jun 01 11:09:30.750051 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'tag': 'c4a9498c-cfd5-4c11-ba25-e4985d580263'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:30.752926 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6278918-613f-439f-abb6-f8895e7d694b" -d '{"events": [{"name": "network-changed", "server_uuid": "4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2", "tag": "c4a9498c-cfd5-4c11-ba25-e4985d580263"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:30.780437 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Pushing event updated for resources: {'Port': ['ID=c4a9498c-cfd5-4c11-ba25-e4985d580263,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:30.784044 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:30.806105 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d177726a-e8cb-4d90-aed1-a28496359cab x-openstack-request-id: req-d177726a-e8cb-4d90-aed1-a28496359cab {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:30.806417 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2", "tag": "c4a9498c-cfd5-4c11-ba25-e4985d580263", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:30.806687 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-d177726a-e8cb-4d90-aed1-a28496359cab {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:30.807100 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'tag': 'c4a9498c-cfd5-4c11-ba25-e4985d580263', 'status': 'completed', 'code': 200}
Jun 01 11:09:30.897031 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2a03d45c-5da4-4fc3-bf76-5ef8b8f774bd x-openstack-request-id: req-2a03d45c-5da4-4fc3-bf76-5ef8b8f774bd {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:30.897423 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2ae35c17-2544-4168-bce0-4d60d97a1698", "tag": "b697fc18-c717-4cd5-a5ec-3378e1131e24", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:30.897762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-2a03d45c-5da4-4fc3-bf76-5ef8b8f774bd {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:30.898244 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2ae35c17-2544-4168-bce0-4d60d97a1698', 'tag': 'b697fc18-c717-4cd5-a5ec-3378e1131e24', 'status': 'completed', 'code': 200}
Jun 01 11:09:31.181192 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b43fd32c-645f-4b6f-8e6d-d6a61c5cb303 req-4191c908-ab4e-4733-8a07-5b03b2f1aada tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.0428474
Jun 01 11:09:31.525650 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee5e0fb-e0b4-4544-bef2-0888713fb76a req-26a2c2c5-f244-4ac9-a99f-d5a939c4e3d7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:31.527096 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3ee5e0fb-e0b4-4544-bef2-0888713fb76a req-26a2c2c5-f244-4ac9-a99f-d5a939c4e3d7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 943 time: 0.0827241
Jun 01 11:09:31.571021 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3ee5e0fb-e0b4-4544-bef2-0888713fb76a req-a9bbf6d1-3318-4499-b4ba-7f236f2d4e3c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377028
Jun 01 11:09:31.905190 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-02e93188-1061-4693-b7e9-bfed5d9bead2 req-677c9186-575a-42b9-a344-ca30db5da27c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0791972
Jun 01 11:09:31.947861 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd827a0-ff56-4af9-afb8-39a4668fc9c9 req-4c334896-830f-4c27-a5f3-61d3bdf88cf6 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:31.949417 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9dd827a0-ff56-4af9-afb8-39a4668fc9c9 req-4c334896-830f-4c27-a5f3-61d3bdf88cf6 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.0919700
Jun 01 11:09:31.994472 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9dd827a0-ff56-4af9-afb8-39a4668fc9c9 req-15cb7ef5-efd6-40fc-af2d-e5900dc7ff6e tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381980
Jun 01 11:09:32.327873 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1e7a0342-a8a3-4c29-9ec9-8644f14ab74a req-0013af16-77d8-4690-8c5e-00fcccf40222 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.0433180
Jun 01 11:09:32.469048 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'port': {'device_id': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'admin_state_up': True, 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'security_groups': ['597e6795-c293-4730-a3b5-4cd55da732ae']}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:32.573717 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.79', 58750) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:32.691500 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-2f2a4558-ea9c-4d0f-b2e5-7bb272e473db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:32.691500 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-2f2a4558-ea9c-4d0f-b2e5-7bb272e473db service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 1098 time: 0.2380188
Jun 01 11:09:32.694423 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6278918-613f-439f-abb6-f8895e7d694b req-a7bbf759-d44a-4a95-9ecf-18cb5e3e201c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:32.701632 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6278918-613f-439f-abb6-f8895e7d694b req-a7bbf759-d44a-4a95-9ecf-18cb5e3e201c service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 1096 time: 0.2006907
Jun 01 11:09:32.747134 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:32.764924 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-6616c905-75f8-4071-8b82-1b3e46674228 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:32.766438 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-6616c905-75f8-4071-8b82-1b3e46674228 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1097 time: 0.2748063
Jun 01 11:09:32.769497 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:32.837192 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:port and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:32.846480 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for port was recalculated. Used quota:3. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:32.850301 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-7656de4d-7ef8-489a-af92-fcaf2075b228 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24 HTTP/1.1" status: 200  len: 217 time: 0.0680873
Jun 01 11:09:32.854160 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:32.927699 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Made reservation on behalf of c004520781bb4854b87284b73cc2a8be for: {'port': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:09:32.933378 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:32.958435 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:32.965171 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-f5895d34-c26a-4978-872a-e5e62d917e54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:32.966620 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-f5895d34-c26a-4978-872a-e5e62d917e54 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 200  len: 858 time: 0.1099050
Jun 01 11:09:33.014165 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Usage tracker for resource:security_group_rule and tenant:c697773770604362975b8a6dfcc33c97 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:33.026920 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:33.059564 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-fb3cda21-b523-4093-a8b9-5248fbcfda27 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=e8c7dea7-722b-446b-9e9f-d27643e48187&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0530903
Jun 01 11:09:33.067483 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:33.075759 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-1b75f2fe-43bb-48b2-b170-9413d2096fd8 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:33.077881 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-1b75f2fe-43bb-48b2-b170-9413d2096fd8 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.79 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 818 time: 0.5033574
Jun 01 11:09:33.184159 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Request body: {'port': {'device_id': '2f8d3be3-e44b-46c1-97d3-b880ab58823a', 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187', 'admin_state_up': True, 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:33.198782 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6278918-613f-439f-abb6-f8895e7d694b req-3556da50-144b-438c-aa4d-06ae6c7f2af2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:33.200331 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6278918-613f-439f-abb6-f8895e7d694b req-3556da50-144b-438c-aa4d-06ae6c7f2af2 service neutron] 10.222.0.79 "GET /v2.0/networks?tenant_id=22a029b4c9f84f4191259891ac3af6c3&shared=False HTTP/1.1" status: 200  len: 911 time: 0.4889436
Jun 01 11:09:33.249767 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6f7e5b8e-c887-4f78-bd16-31e632e38627 req-ca23d2cb-388f-48a3-96ec-a073591f761e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.1959014
Jun 01 11:09:33.275553 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Allocated IP 172.20.0.5 (ce8e721a-c529-4460-882f-9261a0c7ceed/79a8ddfd-a675-47e5-9921-33f71f58d781/6c613458-8891-4e54-aa10-4a7743587916) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:09:33.279200 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-cc88da34-bdc5-4850-9fb8-bf60adcc02bc service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2098546
Jun 01 11:09:33.533574 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af3d13ea-9d44-42c8-9610-9198b9ecc1a5 req-4e879a64-1357-4c6e-9a81-1cd388c46909 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:33.533574 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-af3d13ea-9d44-42c8-9610-9198b9ecc1a5 req-4e879a64-1357-4c6e-9a81-1cd388c46909 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 943 time: 0.7120006
Jun 01 11:09:33.614373 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:33.621896 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6278918-613f-439f-abb6-f8895e7d694b req-516f7039-053f-4d7f-95f4-ba5b5f57c9dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:33.623422 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6278918-613f-439f-abb6-f8895e7d694b req-516f7039-053f-4d7f-95f4-ba5b5f57c9dc service neutron] 10.222.0.79 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.3997908
Jun 01 11:09:33.647708 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Usage tracker for resource:port and tenant:aac1cb46a9b144f5a5fac5f5c98fed2b is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:33.651600 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Quota usage for port was recalculated. Used quota:2. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:33.674865 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:33.680981 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-af3d13ea-9d44-42c8-9610-9198b9ecc1a5 req-c446200b-7545-449b-a2b2-a69e9fd81b9a tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1281257
Jun 01 11:09:33.740023 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:33.744916 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7c8e4a30-4d10-41ae-972b-61ffb1e1a28c req-b2222de5-5ebf-4209-9cc9-3157505d2ef2 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4588366
Jun 01 11:09:33.752265 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:33.761994 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Transition to ACTIVE for port object 6c613458-8891-4e54-aa10-4a7743587916 will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:33.791667 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:33.800698 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:33.807413 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:33.831944 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45cd5ed-f8bb-48b8-a9dd-941f604ddd6b req-047d80dc-44f3-4f88-ae73-e5283ff0fe04 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:33.840712 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a45cd5ed-f8bb-48b8-a9dd-941f604ddd6b req-047d80dc-44f3-4f88-ae73-e5283ff0fe04 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.3826764
Jun 01 11:09:33.846898 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:33.855383 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Made reservation on behalf of aac1cb46a9b144f5a5fac5f5c98fed2b for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:09:33.860165 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:33.926376 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Network ce8e721a-c529-4460-882f-9261a0c7ceed is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:33.931016 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:33.952573 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:09:34.006165 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-22501f19-dca4-4bd6-8070-3144c1b7a097 req-cea454b3-9ea7-4059-98ef-58229d3ca7b8 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 210 time: 0.0975649
Jun 01 11:09:34.008141 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.3109961
Jun 01 11:09:34.078163 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:34.078830 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:34.089060 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:34.092983 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a45cd5ed-f8bb-48b8-a9dd-941f604ddd6b req-0b549e49-0fc1-4b2f-84c4-143997a8121c tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2512953
Jun 01 11:09:34.104773 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=999e720b-255b-4646-93e7-8d002a85ecb1,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:34.107291 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.307s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:34.113908 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:34.135185 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-614cc7d7-f9d1-45db-a35a-d67d970d25d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:34.137948 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-614cc7d7-f9d1-45db-a35a-d67d970d25d1 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 1096 time: 0.4541085
Jun 01 11:09:34.152300 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-01c2be8a-eee1-407f-822b-35230c96cdcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:34.153868 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-01c2be8a-eee1-407f-822b-35230c96cdcf service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1097 time: 0.3153179
Jun 01 11:09:34.155938 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.6938372
Jun 01 11:09:34.253093 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Allocated IP 172.20.0.5 (e8c7dea7-722b-446b-9e9f-d27643e48187/069e04dd-9d3b-4ce0-997c-7cfc632b4fe3/9f011433-de88-40d6-a527-c916faeb6339) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:09:34.282663 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-ee443edc-23a1-44c8-96b6-17bcb843eab2 None None] Provisioning for port 6c613458-8891-4e54-aa10-4a7743587916 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:34.290804 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-ee443edc-23a1-44c8-96b6-17bcb843eab2 None None] Provisioning complete for port 6c613458-8891-4e54-aa10-4a7743587916 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:34.291899 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ee443edc-23a1-44c8-96b6-17bcb843eab2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:34.375109 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-ee443edc-23a1-44c8-96b6-17bcb843eab2 None None] Port 6c613458-8891-4e54-aa10-4a7743587916 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:09:34.598813 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1096e834-f6d9-4106-8267-e67e80315178 req-85e649c6-7c2b-42a3-baf3-b52ca579b66d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:34.600269 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1096e834-f6d9-4106-8267-e67e80315178 req-85e649c6-7c2b-42a3-baf3-b52ca579b66d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 931 time: 0.2027440
Jun 01 11:09:34.602760 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:34.650825 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1096e834-f6d9-4106-8267-e67e80315178 req-c6f88fde-6f3f-4125-ba67-409f35cf4840 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0448234
Jun 01 11:09:34.667418 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:34.673624 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:34.739695 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Network e8c7dea7-722b-446b-9e9f-d27643e48187 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:09:34.742736 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:09:34.746583 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:09:34.784460 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Pushing event updated for resources: {'Port': ['ID=9f011433-de88-40d6-a527-c916faeb6339,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:34.792326 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:34.842645 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:34.843221 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:34.895186 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7648151
Jun 01 11:09:34.914075 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a255db85-e581-4166-bc25-251257c5fa56 req-a3c0883e-1c48-4acf-9f83-9c1a154c5ec3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:34.915448 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a255db85-e581-4166-bc25-251257c5fa56 req-a3c0883e-1c48-4acf-9f83-9c1a154c5ec3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 943 time: 0.1100399
Jun 01 11:09:34.959175 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a255db85-e581-4166-bc25-251257c5fa56 req-d2d3c199-10fd-415f-904c-3d68bc3cf4b1 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0373015
Jun 01 11:09:35.198439 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5190761-3c00-418d-b729-74df5f084671 req-5c330387-47b8-4e90-a081-9925e1a8a237 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:35.199030 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-b5190761-3c00-418d-b729-74df5f084671 req-5c330387-47b8-4e90-a081-9925e1a8a237 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Synchronizing usage tracker for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:35.249470 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-b5190761-3c00-418d-b729-74df5f084671 req-5c330387-47b8-4e90-a081-9925e1a8a237 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Unset dirty status for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:35.250545 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b5190761-3c00-418d-b729-74df5f084671 req-5c330387-47b8-4e90-a081-9925e1a8a237 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 931 time: 0.1284916
Jun 01 11:09:35.308086 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-b5190761-3c00-418d-b729-74df5f084671 req-4389b2a4-bdd1-4993-9d08-3ffc72634ca1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Synchronizing usage tracker for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:09:35.329951 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-b5190761-3c00-418d-b729-74df5f084671 req-4389b2a4-bdd1-4993-9d08-3ffc72634ca1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Unset dirty status for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:09:35.331064 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b5190761-3c00-418d-b729-74df5f084671 req-4389b2a4-bdd1-4993-9d08-3ffc72634ca1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0743465
Jun 01 11:09:35.338718 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc3cafae-6496-483a-baae-fa2be8a3cb66 req-f4749234-5fa1-402e-b926-1171b6d83f73 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:35.340135 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dc3cafae-6496-483a-baae-fa2be8a3cb66 req-f4749234-5fa1-402e-b926-1171b6d83f73 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.1288302
Jun 01 11:09:35.386490 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dc3cafae-6496-483a-baae-fa2be8a3cb66 req-dc66e2ff-289a-4f7b-88c1-d45c85803c96 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405009
Jun 01 11:09:35.908466 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380c9757-5bc2-49d6-b471-c990acf943ca req-d556bdfb-4db6-4747-bf7f-17a90b76fd39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:35.909938 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-380c9757-5bc2-49d6-b471-c990acf943ca req-d556bdfb-4db6-4747-bf7f-17a90b76fd39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 931 time: 0.1468375
Jun 01 11:09:35.953424 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-380c9757-5bc2-49d6-b471-c990acf943ca req-54c2389d-8c4a-4204-a9ea-6aaf4a8ee668 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0380101
Jun 01 11:09:36.142713 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e918bc82-a565-4160-b036-e7deaaee9dae req-f832e39f-d130-468b-a81e-def999af0fe5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:36.144170 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e918bc82-a565-4160-b036-e7deaaee9dae req-f832e39f-d130-468b-a81e-def999af0fe5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 943 time: 0.0806935
Jun 01 11:09:36.190485 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e918bc82-a565-4160-b036-e7deaaee9dae req-ba595af1-a529-463b-87f7-b35659f90178 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405827
Jun 01 11:09:36.566206 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5fcbdb0-dd4d-4547-9e77-46feadca52dc req-a4b15a9d-9ec8-4868-8f3c-47bd0ad240ee tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:36.567574 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5fcbdb0-dd4d-4547-9e77-46feadca52dc req-a4b15a9d-9ec8-4868-8f3c-47bd0ad240ee tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 931 time: 0.1334605
Jun 01 11:09:36.619384 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0206fc84-870f-48ae-9d69-f94b43a082d5 req-0fcff9df-5bb1-4606-aaa2-b530c01b9ea1 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:36.620882 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0206fc84-870f-48ae-9d69-f94b43a082d5 req-0fcff9df-5bb1-4606-aaa2-b530c01b9ea1 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.1313529
Jun 01 11:09:36.628789 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5fcbdb0-dd4d-4547-9e77-46feadca52dc req-78461195-ade3-4fd2-b957-1f2d39d5c723 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0552011
Jun 01 11:09:36.669989 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0206fc84-870f-48ae-9d69-f94b43a082d5 req-82ceac4c-4d21-4c10-aa75-0cd699e88237 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396428
Jun 01 11:09:36.940991 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Request body: {'port': {'device_id': '2f8d3be3-e44b-46c1-97d3-b880ab58823a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:36.957454 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Request body: {'port': {'device_id': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:37.043073 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-2d0b559f-27d6-472d-9448-edfbcef2f402 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263 HTTP/1.1" status: 200  len: 217 time: 0.1059141
Jun 01 11:09:37.137798 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:37.224150 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-83d1bd84-074e-49b1-981e-a2ffbaab8e70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:37.225625 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-83d1bd84-074e-49b1-981e-a2ffbaab8e70 service neutron] 10.222.0.79 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 919 time: 0.2910764
Jun 01 11:09:37.226837 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-ac43b06e-0333-441e-a907-0d1fc18cb0b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:37.228396 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-ac43b06e-0333-441e-a907-0d1fc18cb0b9 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=08c4a15d-0d06-4d4b-909f-10ac28c5c16c HTTP/1.1" status: 200  len: 849 time: 0.1761265
Jun 01 11:09:37.230708 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:37.344997 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-317aef37-3ee1-4727-b7e1-24555ce775c8 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24 HTTP/1.1" status: 200  len: 217 time: 0.1014681
Jun 01 11:09:37.465222 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21fd74c-9486-4e7a-b00a-ba3e60ab0524 req-0b4453e6-4172-4ac3-ad41-a941c0c5faa8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:37.467106 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c21fd74c-9486-4e7a-b00a-ba3e60ab0524 req-0b4453e6-4172-4ac3-ad41-a941c0c5faa8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 931 time: 0.3768439
Jun 01 11:09:37.546494 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-574a2c1c-ca5d-4cf5-b392-994c53801128 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:37.547876 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-574a2c1c-ca5d-4cf5-b392-994c53801128 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=418faffe-faca-4025-ab0f-56771435263e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3053997
Jun 01 11:09:37.573380 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6c613458-8891-4e54-aa10-4a7743587916 {{(pid=119240) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:37.574283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c21fd74c-9486-4e7a-b00a-ba3e60ab0524 req-f8d1e917-36fb-4297-9f64-9fae7d5f39c0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0988913
Jun 01 11:09:37.580862 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:37.596234 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Transition to ACTIVE for port object 6c613458-8891-4e54-aa10-4a7743587916 will not be triggered until provisioned by entity L2. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:37.600167 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:37.604765 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:37.648736 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89261f48-7ceb-45a3-b880-ea6dc579699a req-14d33cfb-1858-4ceb-b6c5-68372c967426 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:37.650203 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89261f48-7ceb-45a3-b880-ea6dc579699a req-14d33cfb-1858-4ceb-b6c5-68372c967426 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 943 time: 0.3342953
Jun 01 11:09:37.797529 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89261f48-7ceb-45a3-b880-ea6dc579699a req-a32ddfdb-5570-43f3-bed7-fcca21a151ed tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1384039
Jun 01 11:09:37.912293 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:37.916668 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.312s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:37.952158 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Attempting to bind port 6c613458-8891-4e54-aa10-4a7743587916 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:37.952495 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Attempting to bind port 6c613458-8891-4e54-aa10-4a7743587916 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:37.952829 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Attempting to bind port 6c613458-8891-4e54-aa10-4a7743587916 on network ce8e721a-c529-4460-882f-9261a0c7ceed {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:37.957631 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Port 6c613458-8891-4e54-aa10-4a7743587916 on network ce8e721a-c529-4460-882f-9261a0c7ceed not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:09:37.958228 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Attempting to bind port 6c613458-8891-4e54-aa10-4a7743587916 on network ce8e721a-c529-4460-882f-9261a0c7ceed {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:37.963929 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 9, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:37.964116 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Checking segment: {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:37.964503 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Bound using segment: {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:37.964938 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Bound port: 6c613458-8891-4e54-aa10-4a7743587916, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'}}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:37.965285 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:38.046063 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9f011433-de88-40d6-a527-c916faeb6339 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:38.061690 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:38.082182 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, cleared binding levels {{(pid=119240) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:38.085211 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119240) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:38.090064 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:38.093065 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Transition to ACTIVE for port object 9f011433-de88-40d6-a527-c916faeb6339 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:09:38.094999 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:38.103622 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:38.113883 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:38.154095 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:38.154602 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:38.155979 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] 10.222.0.79 "PUT /v2.0/ports/6c613458-8891-4e54-aa10-4a7743587916 HTTP/1.1" status: 200  len: 1093 time: 1.2023723
Jun 01 11:09:38.156455 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'tag': '6c613458-8891-4e54-aa10-4a7743587916'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:38.158688 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-03f3677b-403b-4425-b165-8adfa230d772" -d '{"events": [{"name": "network-changed", "server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "tag": "6c613458-8891-4e54-aa10-4a7743587916"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:38.175441 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=3']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:38.178563 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:38.353769 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b26144-6d59-4d79-ba6e-63fa16501b5a req-efd74c96-2abc-432f-8947-03dceb8bab11 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:38.355212 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f9b26144-6d59-4d79-ba6e-63fa16501b5a req-efd74c96-2abc-432f-8947-03dceb8bab11 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.4120955
Jun 01 11:09:38.371215 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c635ee7f-4592-42d3-8d68-9f20935da595 req-ebb3188f-1399-4505-b66d-1f429b6ea3d1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:38.372761 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c635ee7f-4592-42d3-8d68-9f20935da595 req-ebb3188f-1399-4505-b66d-1f429b6ea3d1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 931 time: 0.4285181
Jun 01 11:09:38.413257 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Pushing event updated for resources: {'Port': ['ID=9f011433-de88-40d6-a527-c916faeb6339,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:38.416580 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.303s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:38.536585 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f9b26144-6d59-4d79-ba6e-63fa16501b5a req-89d52cef-c9b3-4bd4-9eb2-e2724bccef0b tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1729887
Jun 01 11:09:38.550479 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c635ee7f-4592-42d3-8d68-9f20935da595 req-62f14116-d9cc-43df-a5ef-3fd29fdc3111 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1328843
Jun 01 11:09:38.572578 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Attempting to bind port 9f011433-de88-40d6-a527-c916faeb6339 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:09:38.573005 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Attempting to bind port 9f011433-de88-40d6-a527-c916faeb6339 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:09:38.573341 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Attempting to bind port 9f011433-de88-40d6-a527-c916faeb6339 on network e8c7dea7-722b-446b-9e9f-d27643e48187 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:38.578452 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Port 9f011433-de88-40d6-a527-c916faeb6339 on network e8c7dea7-722b-446b-9e9f-d27643e48187 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:09:38.578950 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Attempting to bind port 9f011433-de88-40d6-a527-c916faeb6339 on network e8c7dea7-722b-446b-9e9f-d27643e48187 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:09:38.586081 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 9, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:09:38.586422 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Checking segment: {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:09:38.586840 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Bound using segment: {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:09:38.587390 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Bound port: 9f011433-de88-40d6-a527-c916faeb6339, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '282c4d7b-9de4-4e04-b767-7c3bddb71626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 693, 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:09:38.587754 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:38.589421 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69331419-26a3-423d-b295-ed7fba1d03c3 x-openstack-request-id: req-69331419-26a3-423d-b295-ed7fba1d03c3 {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:38.589852 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "tag": "6c613458-8891-4e54-aa10-4a7743587916", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:38.590281 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-69331419-26a3-423d-b295-ed7fba1d03c3 {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:38.590754 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'tag': '6c613458-8891-4e54-aa10-4a7743587916', 'status': 'completed', 'code': 200}
Jun 01 11:09:38.685398 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] For port 9f011433-de88-40d6-a527-c916faeb6339, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:09:38.738364 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] For port 9f011433-de88-40d6-a527-c916faeb6339, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=9f011433-de88-40d6-a527-c916faeb6339,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:09:38.751894 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:38.760964 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:38.830806 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:38.830806 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:38.831401 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] 10.222.0.79 "PUT /v2.0/ports/9f011433-de88-40d6-a527-c916faeb6339 HTTP/1.1" status: 200  len: 1093 time: 1.8955512
Jun 01 11:09:38.831892 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2f8d3be3-e44b-46c1-97d3-b880ab58823a', 'tag': '9f011433-de88-40d6-a527-c916faeb6339'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:38.834161 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-988d6ade-d28a-482e-be71-f44ef57773d1" -d '{"events": [{"name": "network-changed", "server_uuid": "2f8d3be3-e44b-46c1-97d3-b880ab58823a", "tag": "9f011433-de88-40d6-a527-c916faeb6339"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:38.861151 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26f2c856-bed9-4cc7-8419-3474d3fc42fc req-7dc1439b-3cf2-43c8-8f5b-b7a42c0c8d62 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:38.862623 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-26f2c856-bed9-4cc7-8419-3474d3fc42fc req-7dc1439b-3cf2-43c8-8f5b-b7a42c0c8d62 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1745958
Jun 01 11:09:38.863421 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Pushing event updated for resources: {'Port': ['ID=9f011433-de88-40d6-a527-c916faeb6339,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:38.866552 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:38.910998 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-26f2c856-bed9-4cc7-8419-3474d3fc42fc req-94b0d743-edb1-463f-998f-d58e8162964e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404248
Jun 01 11:09:38.970383 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-733f6a7b-5828-4f7c-bfd5-5b667c6814a1 x-openstack-request-id: req-733f6a7b-5828-4f7c-bfd5-5b667c6814a1 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:38.970690 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2f8d3be3-e44b-46c1-97d3-b880ab58823a", "tag": "9f011433-de88-40d6-a527-c916faeb6339", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:38.970961 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-733f6a7b-5828-4f7c-bfd5-5b667c6814a1 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:38.971365 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2f8d3be3-e44b-46c1-97d3-b880ab58823a', 'tag': '9f011433-de88-40d6-a527-c916faeb6339', 'status': 'completed', 'code': 200}
Jun 01 11:09:39.000442 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b151395b-93df-4e52-98ea-5de43219c666 req-f25ac96b-2e81-46f0-aab2-b45f017986b8 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:39.001908 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b151395b-93df-4e52-98ea-5de43219c666 req-f25ac96b-2e81-46f0-aab2-b45f017986b8 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 943 time: 0.0859122
Jun 01 11:09:39.047884 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b151395b-93df-4e52-98ea-5de43219c666 req-bebdc1ce-31fe-4251-b236-785d721c27b9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402484
Jun 01 11:09:39.785663 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fb409b-cdc1-4dc8-96f6-4fc4e1db2d6c req-e0879e99-5f27-4766-ba5a-bbae99195ad2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:39.787123 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-64fb409b-cdc1-4dc8-96f6-4fc4e1db2d6c req-e0879e99-5f27-4766-ba5a-bbae99195ad2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.1416621
Jun 01 11:09:39.794597 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88891762-5e31-49ea-b4a1-a83c721bc040 req-08e8d680-dd86-46a1-9de5-c8707aa5acdf tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:39.796674 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-88891762-5e31-49ea-b4a1-a83c721bc040 req-08e8d680-dd86-46a1-9de5-c8707aa5acdf tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 943 time: 0.1206021
Jun 01 11:09:39.860647 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-64fb409b-cdc1-4dc8-96f6-4fc4e1db2d6c req-621c3f90-a980-4804-b401-5d01d7e7b562 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0629563
Jun 01 11:09:39.870458 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-88891762-5e31-49ea-b4a1-a83c721bc040 req-479ed9af-c229-4512-8d94-926531ff7d6c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599704
Jun 01 11:09:40.106425 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7426890-1e67-427c-a3e9-65600a06bc50 req-1bdbb610-a5d3-45b2-a10e-d12d84642452 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:40.110035 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d7426890-1e67-427c-a3e9-65600a06bc50 req-1bdbb610-a5d3-45b2-a10e-d12d84642452 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0884099
Jun 01 11:09:40.163479 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d7426890-1e67-427c-a3e9-65600a06bc50 req-9db317a0-0a24-4796-ad2e-8875e7ab900b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0488513
Jun 01 11:09:40.244463 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99366c68-495d-430e-8c34-6260fcad68b9 req-a46f061d-78c7-4016-bcd3-6936367f1ba9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:40.245916 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-99366c68-495d-430e-8c34-6260fcad68b9 req-a46f061d-78c7-4016-bcd3-6936367f1ba9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 943 time: 0.0814826
Jun 01 11:09:40.289653 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-99366c68-495d-430e-8c34-6260fcad68b9 req-9ee1dd01-5a0e-4bd9-8f0a-371e831e2caf tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0381236
Jun 01 11:09:40.481010 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-32571969-3ab4-4538-8506-f5deefc83576 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:40.482457 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-32571969-3ab4-4538-8506-f5deefc83576 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 200  len: 858 time: 0.0939155
Jun 01 11:09:40.540699 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-8df38786-cb71-4af4-91e7-78e13febd455 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=e8c7dea7-722b-446b-9e9f-d27643e48187&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0432627
Jun 01 11:09:40.556197 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988d6ade-d28a-482e-be71-f44ef57773d1 req-72876162-88a4-49ec-b2da-2e8b1cf1fe10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:40.557583 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-988d6ade-d28a-482e-be71-f44ef57773d1 req-72876162-88a4-49ec-b2da-2e8b1cf1fe10 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 1096 time: 0.1173570
Jun 01 11:09:40.576818 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-ad7656b1-14bb-486b-b184-f7601ea73c60 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1870680
Jun 01 11:09:40.579479 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f3677b-403b-4425-b165-8adfa230d772 req-c4daf590-2bec-43a5-95ef-36290e49a40f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:40.580844 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-03f3677b-403b-4425-b165-8adfa230d772 req-c4daf590-2bec-43a5-95ef-36290e49a40f service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 1096 time: 0.1732473
Jun 01 11:09:40.835160 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7c0bf65-8f49-492c-ab45-d25e6262e5af req-a3fa5a1f-45fc-4124-be77-41e9e6d845f7 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2431486
Jun 01 11:09:40.836325 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f3677b-403b-4425-b165-8adfa230d772 req-619035f6-cbad-479b-99c4-e7a599e90700 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:40.837630 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-03f3677b-403b-4425-b165-8adfa230d772 req-619035f6-cbad-479b-99c4-e7a599e90700 service neutron] 10.222.0.79 "GET /v2.0/networks?tenant_id=c004520781bb4854b87284b73cc2a8be&shared=False HTTP/1.1" status: 200  len: 917 time: 0.2441075
Jun 01 11:09:40.856737 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-f7f93cc0-e6fb-44a1-ba07-48dfd8e33a8c service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2980788
Jun 01 11:09:40.913878 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988d6ade-d28a-482e-be71-f44ef57773d1 req-3c4e2b8c-38b2-46de-bdd3-01769bd0d3e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:40.915375 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-988d6ade-d28a-482e-be71-f44ef57773d1 req-3c4e2b8c-38b2-46de-bdd3-01769bd0d3e8 service neutron] 10.222.0.79 "GET /v2.0/networks?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&shared=False HTTP/1.1" status: 200  len: 919 time: 0.3370178
Jun 01 11:09:41.091409 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f3677b-403b-4425-b165-8adfa230d772 req-c6e50933-dc66-4d83-b265-784aabae75b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.094542 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-03f3677b-403b-4425-b165-8adfa230d772 req-c6e50933-dc66-4d83-b265-784aabae75b1 service neutron] 10.222.0.79 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2405279
Jun 01 11:09:41.128651 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-efaf306d-8cb4-49f6-9f53-cc5a0ce09357 req-d0cedd66-43f0-4107-8abf-16e059366159 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2582173
Jun 01 11:09:41.188794 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988d6ade-d28a-482e-be71-f44ef57773d1 req-b4eba70a-e835-46e2-84d4-17ca3aba537a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.190266 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-988d6ade-d28a-482e-be71-f44ef57773d1 req-b4eba70a-e835-46e2-84d4-17ca3aba537a service neutron] 10.222.0.79 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2277050
Jun 01 11:09:41.231153 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-baa2ce69-d19e-46e8-8731-254f74e84188 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.233257 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-baa2ce69-d19e-46e8-8731-254f74e84188 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 1096 time: 0.0883002
Jun 01 11:09:41.288651 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7fbff8-cefd-4c9b-8e10-c4e54b721911 req-25176dea-064a-4ac4-9cbe-6e297c57fbcb tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.292522 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4f7fbff8-cefd-4c9b-8e10-c4e54b721911 req-25176dea-064a-4ac4-9cbe-6e297c57fbcb tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.2887473
Jun 01 11:09:41.320240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ac6862-402e-40d1-b65c-de54680e91aa req-ea9ba8d9-558b-4a70-8957-1d828afa8bcb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.322102 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-55ac6862-402e-40d1-b65c-de54680e91aa req-ea9ba8d9-558b-4a70-8957-1d828afa8bcb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 943 time: 0.2688963
Jun 01 11:09:41.433634 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-71d7bbd1-b591-4760-92be-b5901eebb2a9 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=6c613458-8891-4e54-aa10-4a7743587916 HTTP/1.1" status: 200  len: 217 time: 0.1923306
Jun 01 11:09:41.447198 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4f7fbff8-cefd-4c9b-8e10-c4e54b721911 req-186ef508-ef09-4d03-bbe4-ea28e73168f9 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1503909
Jun 01 11:09:41.486092 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-55ac6862-402e-40d1-b65c-de54680e91aa req-f399964d-0c04-4c3f-889b-07228db37546 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1527140
Jun 01 11:09:41.546113 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-785f54ac-8857-4b55-96ab-27c2a0cf3641 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.548380 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-785f54ac-8857-4b55-96ab-27c2a0cf3641 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 1096 time: 0.1711903
Jun 01 11:09:41.655606 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-137fddc7-a09b-446d-9406-97ed7ef6c599 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.657312 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-137fddc7-a09b-446d-9406-97ed7ef6c599 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.1846299
Jun 01 11:09:41.729294 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-2af1cf90-9140-46b3-89bf-5176a2fac852 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=9f011433-de88-40d6-a527-c916faeb6339 HTTP/1.1" status: 200  len: 217 time: 0.1713543
Jun 01 11:09:41.838553 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58216) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:41.852058 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-17b6b585-bef0-4d5a-9658-8ced9364175f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.853481 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-17b6b585-bef0-4d5a-9658-8ced9364175f service neutron] 10.222.0.79 "GET /v2.0/subnets?id=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 200  len: 858 time: 0.1160860
Jun 01 11:09:41.855009 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0fe63f2-adf3-4da6-99b4-b55968599481 req-ab54e970-cc70-400d-9073-44996951136f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.856737 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a0fe63f2-adf3-4da6-99b4-b55968599481 req-ab54e970-cc70-400d-9073-44996951136f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1566281
Jun 01 11:09:41.883971 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b102ed-50e5-405f-95c4-db0e16e100e0 req-e0568c4f-a287-4fe4-b082-f22b8c4c7c80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:41.892128 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-21b102ed-50e5-405f-95c4-db0e16e100e0 req-e0568c4f-a287-4fe4-b082-f22b8c4c7c80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 943 time: 0.2311502
Jun 01 11:09:41.964817 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-984e0916-a8e9-475e-96f0-cdbec63f737e service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=e8c7dea7-722b-446b-9e9f-d27643e48187&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1006265
Jun 01 11:09:41.985655 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a0fe63f2-adf3-4da6-99b4-b55968599481 req-e174360a-8001-4e21-a042-72b36d530ed9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1075852
Jun 01 11:09:42.011000 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-21b102ed-50e5-405f-95c4-db0e16e100e0 req-69721c8d-45e1-4b71-b526-0d30ed939203 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1153774
Jun 01 11:09:42.017884 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-2971df2d-b68f-4550-be58-4b00468504d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:42.027038 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-2971df2d-b68f-4550-be58-4b00468504d4 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3546925
Jun 01 11:09:42.041661 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.064460 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:42.068399 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Usage tracker for resource:security_group_rule and tenant:4ddeb7a83b0b448389f8cf348c3b71e0 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:42.071390 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:42.078047 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:42.179445 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.186541 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.197460 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:42.228973 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58230) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:42.243932 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4abcf51d-2f5b-4328-be70-522524ce332c,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:42.248344 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=4ddeb7a83b0b448389f8cf348c3b71e0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4089043
Jun 01 11:09:42.249455 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:42.251008 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58236) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:42.266792 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-4141eddc-d926-4b5d-b605-a7ae0df4f5ce service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2920880
Jun 01 11:09:42.278411 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-d9b6315b-9b61-4119-bd20-6016a092dc2e service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2037926
Jun 01 11:09:42.315915 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-718b7b29-3357-4b46-a92e-86b5d1df10d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.346324 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device b697fc18-c717-4cd5-a5ec-3378e1131e24 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:09:42.347614 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-718b7b29-3357-4b46-a92e-86b5d1df10d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.396211 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.417146 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:42.421681 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Usage tracker for resource:security_group_rule and tenant:7bfc49d0e2dc4493a64a48ec87a20e24 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:42.426114 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:42.430701 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:42.466979 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-718b7b29-3357-4b46-a92e-86b5d1df10d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.477260 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:42.519932 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-718b7b29-3357-4b46-a92e-86b5d1df10d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4abcf51d-2f5b-4328-be70-522524ce332c,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:42.529923 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-718b7b29-3357-4b46-a92e-86b5d1df10d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:42.582432 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port b697fc18-c717-4cd5-a5ec-3378e1131e24, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:42.584631 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-718b7b29-3357-4b46-a92e-86b5d1df10d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.604007 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-718b7b29-3357-4b46-a92e-86b5d1df10d4 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/4abcf51d-2f5b-4328-be70-522524ce332c HTTP/1.1" status: 204  len: 168 time: 0.3501616
Jun 01 11:09:42.609284 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'b697fc18-c717-4cd5-a5ec-3378e1131e24', 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187', 'port_id': 'b697fc18-c717-4cd5-a5ec-3378e1131e24', 'mac_address': 'fa:16:3e:d7:31:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 693, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '069e04dd-9d3b-4ce0-997c-7cfc632b4fe3', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:09:42.612607 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-060f994b-e4e2-46f3-98e8-0a2b99bf4f5d req-893429b5-1dae-42e7-b147-da92dfacfffb service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3374243
Jun 01 11:09:42.631918 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-eca4c0d6-d2e3-4adf-a962-4705d48a2a0c req-acdf6424-7aac-4168-98ee-0139b6c71607 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3239388
Jun 01 11:09:42.685845 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.715763 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.741526 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b697fc18-c717-4cd5-a5ec-3378e1131e24 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:42.756930 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port b697fc18-c717-4cd5-a5ec-3378e1131e24, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:42.761167 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.764763 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.765539 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c4a9498c-cfd5-4c11-ba25-e4985d580263 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:09:42.770145 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:42.782541 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:42.868429 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=7bfc49d0e2dc4493a64a48ec87a20e24&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6337476
Jun 01 11:09:42.869710 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58258) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:42.870986 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a38d0cbb-9b4e-49e1-9386-bde3f36299b3,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:42.889373 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:42.910110 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856ce3ba-8e1c-4a62-8261-dc1c17be1ee8 req-bd2c41d7-f125-404b-9647-3f17eca95155 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:42.911640 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-856ce3ba-8e1c-4a62-8261-dc1c17be1ee8 req-bd2c41d7-f125-404b-9647-3f17eca95155 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.2286232
Jun 01 11:09:42.943849 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d0283bd-0338-43fe-93a6-998b2eb6ce3d req-64609aaf-3ecc-4322-aa21-159ee62e6beb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:42.945480 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6d0283bd-0338-43fe-93a6-998b2eb6ce3d req-64609aaf-3ecc-4322-aa21-159ee62e6beb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 943 time: 0.2578850
Jun 01 11:09:42.965224 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=b697fc18-c717-4cd5-a5ec-3378e1131e24,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:42.969184 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91997ca1-be07-4a1d-b5c0-f1cb16baaa41 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:42.969816 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:43.012398 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91997ca1-be07-4a1d-b5c0-f1cb16baaa41 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:43.018042 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c4a9498c-cfd5-4c11-ba25-e4985d580263, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:43.032283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-856ce3ba-8e1c-4a62-8261-dc1c17be1ee8 req-b5319e3e-d4fc-49cb-a9c1-5de7b90dd325 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1131442
Jun 01 11:09:43.041151 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'c4a9498c-cfd5-4c11-ba25-e4985d580263', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'port_id': 'c4a9498c-cfd5-4c11-ba25-e4985d580263', 'mac_address': 'fa:16:3e:5d:c0:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:09:43.064908 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6d0283bd-0338-43fe-93a6-998b2eb6ce3d req-9b39790e-ecd3-475d-841d-b5f24c237e7d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1117718
Jun 01 11:09:43.156578 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91997ca1-be07-4a1d-b5c0-f1cb16baaa41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:43.162065 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:43.164794 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5415da98-6ca6-4d26-aac9-70671f931759 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:43.190069 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91997ca1-be07-4a1d-b5c0-f1cb16baaa41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a38d0cbb-9b4e-49e1-9386-bde3f36299b3,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:43.190267 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c4a9498c-cfd5-4c11-ba25-e4985d580263 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:43.201033 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-91997ca1-be07-4a1d-b5c0-f1cb16baaa41 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:43.204801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91997ca1-be07-4a1d-b5c0-f1cb16baaa41 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:43.210823 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-91997ca1-be07-4a1d-b5c0-f1cb16baaa41 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/a38d0cbb-9b4e-49e1-9386-bde3f36299b3 HTTP/1.1" status: 204  len: 168 time: 0.3410125
Jun 01 11:09:43.232920 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c4a9498c-cfd5-4c11-ba25-e4985d580263, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:43.239713 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:43.250252 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:43.424110 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=c4a9498c-cfd5-4c11-ba25-e4985d580263,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:43.431261 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:43.445460 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9389654-04e0-4392-8808-21f8b76678f1 req-432aecb5-2b22-43b4-9dd0-29bc30d76a75 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:43.446999 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d9389654-04e0-4392-8808-21f8b76678f1 req-432aecb5-2b22-43b4-9dd0-29bc30d76a75 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.2945747
Jun 01 11:09:43.483873 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['c4a9498c-cfd5-4c11-ba25-e4985d580263'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:09:43.517747 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d9389654-04e0-4392-8808-21f8b76678f1 req-909c9400-fe7d-4af2-aff7-22bf4d198bdc tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0618725
Jun 01 11:09:43.553234 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['b697fc18-c717-4cd5-a5ec-3378e1131e24'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:09:43.555725 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27fc5a9f-3d5d-4725-bcad-f488c168eac7 req-07c82a57-ee58-4074-85b5-16c2c585669f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:43.557577 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-27fc5a9f-3d5d-4725-bcad-f488c168eac7 req-07c82a57-ee58-4074-85b5-16c2c585669f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 944 time: 0.2678406
Jun 01 11:09:43.670948 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-27fc5a9f-3d5d-4725-bcad-f488c168eac7 req-a53a2edc-e2c4-4dce-9bb1-0cb34f5dd4d2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1008432
Jun 01 11:09:43.864051 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58320) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:43.897501 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:43.920962 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:43.934054 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Usage tracker for resource:security_group_rule and tenant:241575413aec438ab876d9cd27494936 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:43.937511 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:43.944481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:44.063397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:44.068571 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:44.081598 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e2ae8c21-c3aa-427b-ba89-2d1b08d6a424 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:44.126711 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=241575413aec438ab876d9cd27494936&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2582397
Jun 01 11:09:44.126711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b213ef0e-b4ef-4abf-9ce1-0549c54bf66c,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:44.127044 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58338) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:44.130800 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:44.193901 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-be667abc-5e28-4fa4-af58-99b16f25eea4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:44.222811 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-be667abc-5e28-4fa4-af58-99b16f25eea4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:44.287862 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-be667abc-5e28-4fa4-af58-99b16f25eea4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:44.294021 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:44.305796 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be667abc-5e28-4fa4-af58-99b16f25eea4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b213ef0e-b4ef-4abf-9ce1-0549c54bf66c,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:44.306393 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26d61b0-4be3-4183-80d0-8087acea1a01 req-b829ffc9-7ea7-45ec-9e02-547bf755c224 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:44.309199 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d26d61b0-4be3-4183-80d0-8087acea1a01 req-b829ffc9-7ea7-45ec-9e02-547bf755c224 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 943 time: 0.1098258
Jun 01 11:09:44.309506 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-be667abc-5e28-4fa4-af58-99b16f25eea4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:44.314296 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-be667abc-5e28-4fa4-af58-99b16f25eea4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:44.320616 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-be667abc-5e28-4fa4-af58-99b16f25eea4 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/b213ef0e-b4ef-4abf-9ce1-0549c54bf66c HTTP/1.1" status: 204  len: 168 time: 0.1924813
Jun 01 11:09:44.342937 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 9f011433-de88-40d6-a527-c916faeb6339 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:09:44.361083 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d26d61b0-4be3-4183-80d0-8087acea1a01 req-14395c7e-a569-41df-97b0-56b1f87743a1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0450048
Jun 01 11:09:44.492185 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 9f011433-de88-40d6-a527-c916faeb6339, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=9f011433-de88-40d6-a527-c916faeb6339,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:44.506960 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '9f011433-de88-40d6-a527-c916faeb6339', 'network_id': 'e8c7dea7-722b-446b-9e9f-d27643e48187', 'port_id': '9f011433-de88-40d6-a527-c916faeb6339', 'mac_address': 'fa:16:3e:b8:08:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 693, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '069e04dd-9d3b-4ce0-997c-7cfc632b4fe3', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:09:44.567924 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:44.589446 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9f011433-de88-40d6-a527-c916faeb6339 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:44.608712 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 9f011433-de88-40d6-a527-c916faeb6339, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=9f011433-de88-40d6-a527-c916faeb6339,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:44.613900 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:44.614624 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:09:44.618769 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-6d512a4a-dff5-414a-8b2c-4d483c46d603 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:44.769042 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025c784f-cb7f-4ff8-b493-584a0cdcdcb9 req-e01aecfb-13b1-4d09-99fa-9ac1f47a56af tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:44.769042 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-025c784f-cb7f-4ff8-b493-584a0cdcdcb9 req-e01aecfb-13b1-4d09-99fa-9ac1f47a56af tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1270015
Jun 01 11:09:44.831896 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=9f011433-de88-40d6-a527-c916faeb6339,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:44.854116 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:44.952067 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:44.953808 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-025c784f-cb7f-4ff8-b493-584a0cdcdcb9 req-efc610e4-061d-49f6-bede-23e3e073ebdf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1712165
Jun 01 11:09:44.974928 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '6c613458-8891-4e54-aa10-4a7743587916', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'port_id': '6c613458-8891-4e54-aa10-4a7743587916', 'mac_address': 'fa:16:3e:c8:58:1c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:09:45.009115 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee77481b-640a-43f6-bf47-53ea960c655c req-ec006b65-93f4-479c-9bfb-97bd460e951f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:45.010749 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ee77481b-640a-43f6-bf47-53ea960c655c req-ec006b65-93f4-479c-9bfb-97bd460e951f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 944 time: 0.1511853
Jun 01 11:09:45.050213 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:45.062144 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ee77481b-640a-43f6-bf47-53ea960c655c req-08b0b05f-1958-4db8-82ed-f2d2ac65634c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0450640
Jun 01 11:09:45.079803 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6c613458-8891-4e54-aa10-4a7743587916 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:09:45.125903 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:45.135266 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:45.137120 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:45.242599 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:45.245834 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:45.249755 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:45.402323 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['6c613458-8891-4e54-aa10-4a7743587916'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:09:45.469215 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['9f011433-de88-40d6-a527-c916faeb6339'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:09:45.635030 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a700fe79-ad66-4089-aeea-197960cca4a6 req-2f761c95-f5b4-4978-9706-98b5834dbc35 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:45.641968 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a700fe79-ad66-4089-aeea-197960cca4a6 req-2f761c95-f5b4-4978-9706-98b5834dbc35 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 944 time: 0.1045241
Jun 01 11:09:45.712634 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a700fe79-ad66-4089-aeea-197960cca4a6 req-5d3c0485-9d6a-4f01-8691-bb7783a479fb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0697391
Jun 01 11:09:46.074540 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58470) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:46.195754 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36032039-d35e-49f6-8c2f-80c83d08d33a req-33276485-e3fa-4dc8-b8fd-1100856d05c9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:46.197418 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-36032039-d35e-49f6-8c2f-80c83d08d33a req-33276485-e3fa-4dc8-b8fd-1100856d05c9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 944 time: 0.0970886
Jun 01 11:09:46.224367 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.238267 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:46.242277 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Usage tracker for resource:security_group_rule and tenant:864dca89e86249019131af6f3e15f0be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:46.245158 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:46.252151 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:46.303619 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-36032039-d35e-49f6-8c2f-80c83d08d33a req-3117bec7-6845-484c-a2a7-bd97618a8270 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0680344
Jun 01 11:09:46.327434 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1509b9f-1a51-45d3-a288-948b7969b812 req-cc5feb8b-6e3e-42c8-a18e-d913157b63ad tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:46.328912 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b1509b9f-1a51-45d3-a288-948b7969b812 req-cc5feb8b-6e3e-42c8-a18e-d913157b63ad tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 944 time: 0.1304741
Jun 01 11:09:46.348001 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device b697fc18-c717-4cd5-a5ec-3378e1131e24 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:46.351225 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.356938 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.366311 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:46.375112 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b1509b9f-1a51-45d3-a288-948b7969b812 req-a8a3c77c-ed94-44bc-b1a2-956a201b669d tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399733
Jun 01 11:09:46.407733 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=864dca89e86249019131af6f3e15f0be&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3316226
Jun 01 11:09:46.408610 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eec84188-119f-4ea3-b000-ddb6f7ca25dc,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:46.410579 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58478) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:46.422556 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port b697fc18-c717-4cd5-a5ec-3378e1131e24 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:46.427777 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port b697fc18-c717-4cd5-a5ec-3378e1131e24 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:46.428175 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.428856 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.429224 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.429581 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.429932 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.430278 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.430621 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.430966 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.431307 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.431683 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.432025 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.432362 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.432698 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:46.437098 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:46.485336 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9961ec41-cdbf-4e1b-b888-2ea40d43d49b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.515844 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9961ec41-cdbf-4e1b-b888-2ea40d43d49b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.548712 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.573603 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9961ec41-cdbf-4e1b-b888-2ea40d43d49b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.579143 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ae35c17-2544-4168-bce0-4d60d97a1698', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b697fc18-c717-4cd5-a5ec-3378e1131e24'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:46.580776 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-697b363c-271b-4c74-9e85-04f0ef1a7b96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:46.581664 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fe66df1-9f10-4113-87a2-e4e01faebdc1" -d '{"events": [{"server_uuid": "2ae35c17-2544-4168-bce0-4d60d97a1698", "name": "network-vif-plugged", "status": "completed", "tag": "b697fc18-c717-4cd5-a5ec-3378e1131e24"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:46.594752 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port b697fc18-c717-4cd5-a5ec-3378e1131e24, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:46.597080 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9961ec41-cdbf-4e1b-b888-2ea40d43d49b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eec84188-119f-4ea3-b000-ddb6f7ca25dc,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:46.601608 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9961ec41-cdbf-4e1b-b888-2ea40d43d49b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:46.605724 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9961ec41-cdbf-4e1b-b888-2ea40d43d49b admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.612764 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-9961ec41-cdbf-4e1b-b888-2ea40d43d49b admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/eec84188-119f-4ea3-b000-ddb6f7ca25dc HTTP/1.1" status: 204  len: 168 time: 0.2009623
Jun 01 11:09:46.622656 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.624648 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c4a9498c-cfd5-4c11-ba25-e4985d580263 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:46.649985 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd008b1d-31d2-49f9-8b85-f67c7dbc2d53 x-openstack-request-id: req-cd008b1d-31d2-49f9-8b85-f67c7dbc2d53 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:46.650282 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ae35c17-2544-4168-bce0-4d60d97a1698", "name": "network-vif-plugged", "status": "completed", "tag": "b697fc18-c717-4cd5-a5ec-3378e1131e24", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:46.650536 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-cd008b1d-31d2-49f9-8b85-f67c7dbc2d53 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:46.650919 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ae35c17-2544-4168-bce0-4d60d97a1698', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b697fc18-c717-4cd5-a5ec-3378e1131e24', 'code': 200}
Jun 01 11:09:46.659871 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-92d9a2bc-22d7-42ec-99f1-97545be6289e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:46.764707 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=b697fc18-c717-4cd5-a5ec-3378e1131e24,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:46.768520 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:46.780828 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port c4a9498c-cfd5-4c11-ba25-e4985d580263 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:46.787665 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port c4a9498c-cfd5-4c11-ba25-e4985d580263 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:46.788058 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:46.944303 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58500) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:47.034534 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:47.069672 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11092e05-a4ad-4caa-9508-426f776b01e1 req-95882526-c3e6-495e-8b90-8f28da76bca3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:47.070787 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-11092e05-a4ad-4caa-9508-426f776b01e1 req-95882526-c3e6-495e-8b90-8f28da76bca3 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1099 time: 0.1620350
Jun 01 11:09:47.110551 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd91ec1b-c348-4c68-aa3a-6ee1451c1506 req-42bfd4b5-d676-4816-af54-0b46a110f4f9 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:47.113517 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd91ec1b-c348-4c68-aa3a-6ee1451c1506 req-42bfd4b5-d676-4816-af54-0b46a110f4f9 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 944 time: 0.1542432
Jun 01 11:09:47.129447 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c4a9498c-cfd5-4c11-ba25-e4985d580263, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:47.141926 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:47.145085 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:47.176896 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-11092e05-a4ad-4caa-9508-426f776b01e1 req-a96fc860-f0a9-4ba6-8dd0-1ef6f418abd6 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0955138
Jun 01 11:09:47.281384 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:47.297200 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd91ec1b-c348-4c68-aa3a-6ee1451c1506 req-ac98380a-20c1-4f09-9415-16e2d2e62b0d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1772909
Jun 01 11:09:47.301114 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:47.305521 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Usage tracker for resource:security_group_rule and tenant:bfe6e3ff40b24bd29a6eee4d1e7a401b is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:47.308727 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:47.313525 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=c4a9498c-cfd5-4c11-ba25-e4985d580263,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:47.316727 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:47.324850 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:47.433638 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:47.439277 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:47.474397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:47.610347 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=bfe6e3ff40b24bd29a6eee4d1e7a401b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6645656
Jun 01 11:09:47.611215 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05a2fcc1-ff02-4857-b5fe-353c860f7002,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:47.613107 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58540) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:47.635505 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.636248 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.636769 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.637120 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.637465 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.637806 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.638201 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.639056 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.639399 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.639765 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.640103 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.640434 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:09:47.644516 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:47.682172 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c677fe-7774-4487-96df-f2e1fc87f988 req-dd53ed0e-60d9-4168-adf0-0de546e114a3 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:47.683708 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-93c677fe-7774-4487-96df-f2e1fc87f988 req-dd53ed0e-60d9-4168-adf0-0de546e114a3 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 944 time: 0.2102685
Jun 01 11:09:47.698368 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7e32e5c9-5d4d-4b54-b777-b1599aeab2fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:47.729221 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7e32e5c9-5d4d-4b54-b777-b1599aeab2fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:47.729670 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa2b4fe-99f6-4d20-872f-c3803900c7e6 req-f43e9832-a9d3-4b26-82aa-08c727225f8c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:47.731133 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cfa2b4fe-99f6-4d20-872f-c3803900c7e6 req-f43e9832-a9d3-4b26-82aa-08c727225f8c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1897633
Jun 01 11:09:47.767580 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-93c677fe-7774-4487-96df-f2e1fc87f988 req-fe12c7d8-c2c6-463d-9555-346a73575311 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0745208
Jun 01 11:09:47.794213 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7e32e5c9-5d4d-4b54-b777-b1599aeab2fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:47.800133 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cfa2b4fe-99f6-4d20-872f-c3803900c7e6 req-7149660a-4248-4441-811f-e5afb1aa0acf tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0593359
Jun 01 11:09:47.804050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7ce37959-658f-4f1e-bea2-cf642f59f5be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:47.816666 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e32e5c9-5d4d-4b54-b777-b1599aeab2fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05a2fcc1-ff02-4857-b5fe-353c860f7002,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:47.818980 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7e32e5c9-5d4d-4b54-b777-b1599aeab2fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:47.822655 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7e32e5c9-5d4d-4b54-b777-b1599aeab2fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:47.824404 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7e32e5c9-5d4d-4b54-b777-b1599aeab2fa admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/05a2fcc1-ff02-4857-b5fe-353c860f7002 HTTP/1.1" status: 204  len: 168 time: 0.2101874
Jun 01 11:09:48.230758 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58594) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:48.251965 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.269661 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:48.274153 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Usage tracker for resource:security_group_rule and tenant:d0916e751c7841ae99520210e560a330 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:48.277682 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:48.285096 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:48.368528 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 9f011433-de88-40d6-a527-c916faeb6339 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:48.372006 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.376830 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.386814 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-bb15ec0c-b70c-442c-b065-8ed4bacaa4ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:48.444943 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=d0916e751c7841ae99520210e560a330&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2130957
Jun 01 11:09:48.446219 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19b39499-f6b1-4806-be32-8c72cd101aca,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:48.448940 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58604) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:48.452636 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:48.518511 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e77c65e5-b7ed-47eb-8a76-03deb938dc9d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.536393 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 9f011433-de88-40d6-a527-c916faeb6339 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:48.541812 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 9f011433-de88-40d6-a527-c916faeb6339 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:48.542199 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.563217 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e77c65e5-b7ed-47eb-8a76-03deb938dc9d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.582391 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3896d31-0279-4ada-8c59-33729294ab26 req-89261758-b00c-409a-8099-ae51e900a872 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:48.584135 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a3896d31-0279-4ada-8c59-33729294ab26 req-89261758-b00c-409a-8099-ae51e900a872 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 944 time: 0.1442807
Jun 01 11:09:48.645233 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e77c65e5-b7ed-47eb-8a76-03deb938dc9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.654403 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-018a28a4-c750-4c4e-9533-fa5db6c90166 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:48.657501 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a3896d31-0279-4ada-8c59-33729294ab26 req-159661fc-adbf-48da-9fa8-5de0f60b8ee5 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0660460
Jun 01 11:09:48.662876 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c4a9498c-cfd5-4c11-ba25-e4985d580263'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:48.667205 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8d5aa6d-0e98-4ed8-9ea0-e8fb9d5cb63e" -d '{"events": [{"server_uuid": "4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2", "name": "network-vif-plugged", "status": "completed", "tag": "c4a9498c-cfd5-4c11-ba25-e4985d580263"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:48.670152 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e77c65e5-b7ed-47eb-8a76-03deb938dc9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19b39499-f6b1-4806-be32-8c72cd101aca,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:48.695541 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e77c65e5-b7ed-47eb-8a76-03deb938dc9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:48.695541 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e77c65e5-b7ed-47eb-8a76-03deb938dc9d admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.695541 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e77c65e5-b7ed-47eb-8a76-03deb938dc9d admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/19b39499-f6b1-4806-be32-8c72cd101aca HTTP/1.1" status: 204  len: 168 time: 0.2420578
Jun 01 11:09:48.740409 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed9a290a-8284-4f9a-870e-5828821f3ded x-openstack-request-id: req-ed9a290a-8284-4f9a-870e-5828821f3ded {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:48.740731 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2", "name": "network-vif-plugged", "status": "completed", "tag": "c4a9498c-cfd5-4c11-ba25-e4985d580263", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:48.740998 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-ed9a290a-8284-4f9a-870e-5828821f3ded {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:48.741388 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c4a9498c-cfd5-4c11-ba25-e4985d580263', 'code': 200}
Jun 01 11:09:48.741982 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.794634 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 9f011433-de88-40d6-a527-c916faeb6339, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=9f011433-de88-40d6-a527-c916faeb6339,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:48.802343 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:48.803435 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:09:48.857375 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-92d9a2bc-22d7-42ec-99f1-97545be6289e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:49.070066 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=9f011433-de88-40d6-a527-c916faeb6339,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:49.088909 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6132ddc-95b0-4010-bbc5-861cae2e189c req-a51f45ee-664c-4165-b8d4-709d0e0f51c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:49.089983 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:49.092581 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-d6132ddc-95b0-4010-bbc5-861cae2e189c req-a51f45ee-664c-4165-b8d4-709d0e0f51c4 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 1098 time: 0.1567369
Jun 01 11:09:49.103514 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 6c613458-8891-4e54-aa10-4a7743587916 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:09:49.113664 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 6c613458-8891-4e54-aa10-4a7743587916 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:09:49.114319 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:49.159466 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-d6132ddc-95b0-4010-bbc5-861cae2e189c req-facdb653-4ce0-4deb-96f3-3f130c82cce2 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0601585
Jun 01 11:09:49.312956 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5624d17a-93c4-475d-bca7-515925ededf2 req-d7a99c21-e2fa-48a9-98d9-489198c74518 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:49.319617 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5624d17a-93c4-475d-bca7-515925ededf2 req-d7a99c21-e2fa-48a9-98d9-489198c74518 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.3166420
Jun 01 11:09:49.400580 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:49.460393 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb74d19c-c61d-43d9-abe9-9581bb3b317b req-92aa7fd0-c4d8-4c4d-b118-749cc69f2036 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:49.463287 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fb74d19c-c61d-43d9-abe9-9581bb3b317b req-92aa7fd0-c4d8-4c4d-b118-749cc69f2036 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 944 time: 0.3402109
Jun 01 11:09:49.471692 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:49.485042 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:49.487526 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:49.540685 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5624d17a-93c4-475d-bca7-515925ededf2 req-838a6f6d-c268-458b-a44a-6624039b75a7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2123730
Jun 01 11:09:49.595045 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fb74d19c-c61d-43d9-abe9-9581bb3b317b req-c8dd1baf-39c4-4a35-9cb5-8bdbf479ea00 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1268117
Jun 01 11:09:49.608672 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:49.612824 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:49.852485 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892990f1-8662-43fd-bcbe-45ed9098c940 req-2e21a35a-41d4-4446-b6f8-15ba0d534ce5 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:49.854185 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-892990f1-8662-43fd-bcbe-45ed9098c940 req-2e21a35a-41d4-4446-b6f8-15ba0d534ce5 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0832877
Jun 01 11:09:49.901771 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-892990f1-8662-43fd-bcbe-45ed9098c940 req-b3826d3d-9a51-41c6-b497-c0cb84750e96 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391006
Jun 01 11:09:50.742928 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f8d3be3-e44b-46c1-97d3-b880ab58823a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f011433-de88-40d6-a527-c916faeb6339'}, {'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c613458-8891-4e54-aa10-4a7743587916'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:50.748250 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5119593-87eb-4b92-abbb-1f0fbf04ebdd" -d '{"events": [{"server_uuid": "2f8d3be3-e44b-46c1-97d3-b880ab58823a", "name": "network-vif-plugged", "status": "completed", "tag": "9f011433-de88-40d6-a527-c916faeb6339"}, {"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-plugged", "status": "completed", "tag": "6c613458-8891-4e54-aa10-4a7743587916"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:50.896287 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e57f76-9120-4132-8011-6b1a6161ce0d req-d4a80c0c-ecd8-438b-8772-85523d0833da tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:50.898345 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-77e57f76-9120-4132-8011-6b1a6161ce0d req-d4a80c0c-ecd8-438b-8772-85523d0833da tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1773214
Jun 01 11:09:50.915261 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025b767a-1ed5-4f43-b890-aedad8252e31 req-8fcdb62d-7f6d-411e-b5de-fabfaea56577 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:50.916908 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-025b767a-1ed5-4f43-b890-aedad8252e31 req-8fcdb62d-7f6d-411e-b5de-fabfaea56577 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1478434
Jun 01 11:09:50.998252 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-77e57f76-9120-4132-8011-6b1a6161ce0d req-3ebbdd33-4337-412d-91c1-72c4e618ca0e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0916843
Jun 01 11:09:51.009689 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-025b767a-1ed5-4f43-b890-aedad8252e31 req-fdb34e83-4176-426a-9bf9-92e37ea06b93 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0764754
Jun 01 11:09:51.068234 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58714) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:51.072800 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58ecfa62-5c03-43a6-979a-fb4a657d348b x-openstack-request-id: req-58ecfa62-5c03-43a6-979a-fb4a657d348b {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:51.073072 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f8d3be3-e44b-46c1-97d3-b880ab58823a", "name": "network-vif-plugged", "status": "completed", "tag": "9f011433-de88-40d6-a527-c916faeb6339", "code": 200}, {"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-plugged", "status": "completed", "tag": "6c613458-8891-4e54-aa10-4a7743587916", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:51.073330 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-58ecfa62-5c03-43a6-979a-fb4a657d348b {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:51.073729 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f8d3be3-e44b-46c1-97d3-b880ab58823a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f011433-de88-40d6-a527-c916faeb6339', 'code': 200}
Jun 01 11:09:51.073990 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c613458-8891-4e54-aa10-4a7743587916', 'code': 200}
Jun 01 11:09:51.295256 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:51.336618 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e572761-dc77-4234-b66d-7ac6ccba3d7a req-66f06307-dfc3-425a-931e-d1fc817c2ac4 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:51.338132 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8e572761-dc77-4234-b66d-7ac6ccba3d7a req-66f06307-dfc3-425a-931e-d1fc817c2ac4 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1140251
Jun 01 11:09:51.342499 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:51.346535 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Usage tracker for resource:security_group_rule and tenant:1a613fb7ff0c4d2e8374282db5fe90c6 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:51.346805 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd3b8f74-eca4-4fc7-af4d-c9a22733d5b2 req-07446903-94d3-4139-882a-4244bec1d0f3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:51.349689 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:51.355655 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:51.357248 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd3b8f74-eca4-4fc7-af4d-c9a22733d5b2 req-07446903-94d3-4139-882a-4244bec1d0f3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1774030
Jun 01 11:09:51.357810 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58728) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:51.376790 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'floatingip': {'port_id': 'c4a9498c-cfd5-4c11-ba25-e4985d580263'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:51.472656 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:51.571121 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:51.577219 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:51.587262 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-55e52537-6d65-40ad-9168-ea0ac820b032 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:51.594498 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c07f4fe4-2591-42f3-94a3-058876975e81 req-d39b28b8-2f45-41ac-aaea-a27b2c8164b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:51.595997 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c07f4fe4-2591-42f3-94a3-058876975e81 req-d39b28b8-2f45-41ac-aaea-a27b2c8164b4 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 1098 time: 0.2087076
Jun 01 11:09:51.605668 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8e572761-dc77-4234-b66d-7ac6ccba3d7a req-1152f56b-354a-4e33-a946-97fe91ae82a9 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2468867
Jun 01 11:09:51.608105 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a6db7a-ec96-44c7-94e4-f365a2272a87 req-37b04d6e-fb59-47f9-ad21-edf4050b4dcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:51.609495 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-93a6db7a-ec96-44c7-94e4-f365a2272a87 req-37b04d6e-fb59-47f9-ad21-edf4050b4dcd service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 1098 time: 0.1748745
Jun 01 11:09:51.671089 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=1a613fb7ff0c4d2e8374282db5fe90c6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6017768
Jun 01 11:09:51.672013 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f30dd48-0278-44b9-a597-9ff28ae78235,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:51.673887 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58732) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:51.681716 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:51.706008 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-93a6db7a-ec96-44c7-94e4-f365a2272a87 req-26d1bdb4-fc26-4077-9fc5-7eaa2bf09c68 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0696585
Jun 01 11:09:51.706671 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c07f4fe4-2591-42f3-94a3-058876975e81 req-1094c87b-aaf1-4db8-9c1f-4e93d4662e7c service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1024363
Jun 01 11:09:51.948659 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c0dfbc7a-9d64-4bf3-94ed-f819bcca12ba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:52.063854 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c0dfbc7a-9d64-4bf3-94ed-f819bcca12ba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:52.374503 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c0dfbc7a-9d64-4bf3-94ed-f819bcca12ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:52.386650 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0cb53050-3fd8-4f35-9dce-843b516da9d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:52.400554 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aca579e-1c01-4faf-97f4-91ad19e21dbc req-66af0720-33cc-4f12-b13c-7e5fa4fdfb3f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:52.402377 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9aca579e-1c01-4faf-97f4-91ad19e21dbc req-66af0720-33cc-4f12-b13c-7e5fa4fdfb3f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2208047
Jun 01 11:09:52.416715 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0dfbc7a-9d64-4bf3-94ed-f819bcca12ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f30dd48-0278-44b9-a597-9ff28ae78235,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:52.422151 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c0dfbc7a-9d64-4bf3-94ed-f819bcca12ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:52.451319 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.db.resource_extend [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 11:09:52.539116 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c0dfbc7a-9d64-4bf3-94ed-f819bcca12ba admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:52.540268 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c0dfbc7a-9d64-4bf3-94ed-f819bcca12ba admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/1f30dd48-0278-44b9-a597-9ff28ae78235 HTTP/1.1" status: 204  len: 168 time: 0.8654726
Jun 01 11:09:52.559621 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9aca579e-1c01-4faf-97f4-91ad19e21dbc req-03e81e88-ae7b-465c-bb50-47dd4b15ba52 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1440942
Jun 01 11:09:52.569326 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:52.574699 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:52.713421 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-5d1d7c04-1191-4ef5-9091-2d50eb049acd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:52.808249 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Floating IP 78d6aaef-834f-4604-a6cb-fec4c348d4e0 associated. External IP: 172.27.3.86, port: c4a9498c-cfd5-4c11-ba25-e4985d580263.
Jun 01 11:09:52.874674 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58760) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:52.893126 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:52.912227 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:52.916966 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Usage tracker for resource:security_group_rule and tenant:becb517e8d8248aba726cb1e7e9ab8a6 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:52.921972 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:52.928612 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:52.932991 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e2ddd4-1602-4069-ae93-c6badb9b2471 req-c0bfb7f3-0eac-47c2-89ee-913dae5438ce tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:52.944142 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-78e2ddd4-1602-4069-ae93-c6badb9b2471 req-c0bfb7f3-0eac-47c2-89ee-913dae5438ce tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.2029791
Jun 01 11:09:53.050929 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:53.055992 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:53.064449 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:53.106235 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=becb517e8d8248aba726cb1e7e9ab8a6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2303233
Jun 01 11:09:53.109432 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 58768) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:53.128813 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=682992a7-55c1-438a-ae30-6a750b600af5,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:53.131865 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:53.187214 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0c231207-a24d-4a5b-bf6a-acd11c459361 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:53.212938 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0c231207-a24d-4a5b-bf6a-acd11c459361 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:53.244077 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-78e2ddd4-1602-4069-ae93-c6badb9b2471 req-82dbf00c-4a5a-4904-80cc-0a8541eac0df tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1955357
Jun 01 11:09:53.283740 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0c231207-a24d-4a5b-bf6a-acd11c459361 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:53.287568 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:53.301689 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c231207-a24d-4a5b-bf6a-acd11c459361 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=682992a7-55c1-438a-ae30-6a750b600af5,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:53.310675 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0c231207-a24d-4a5b-bf6a-acd11c459361 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:53.321660 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0c231207-a24d-4a5b-bf6a-acd11c459361 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:53.325115 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-0c231207-a24d-4a5b-bf6a-acd11c459361 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/682992a7-55c1-438a-ae30-6a750b600af5 HTTP/1.1" status: 204  len: 168 time: 0.2125289
Jun 01 11:09:53.380860 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Router abf03e4b-fdd0-44b3-86be-277da7892b4a has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:09:53.653305 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:09:53.658318 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:53.667264 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] Sync routers for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:09:53.679870 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:53.680497 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579910e8b0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:09:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:53.784643 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c6b57725-0396-49f8-b112-29cd7373c0ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "PUT /v2.0/floatingips/78d6aaef-834f-4604-a6cb-fec4c348d4e0 HTTP/1.1" status: 200  len: 990 time: 2.4221785
Jun 01 11:09:53.788471 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'tag': 'c4a9498c-cfd5-4c11-ba25-e4985d580263'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:53.790873 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-42d68dcf-3899-4a5b-a093-67674244a653" -d '{"events": [{"name": "network-changed", "server_uuid": "4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2", "tag": "c4a9498c-cfd5-4c11-ba25-e4985d580263"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:53.848170 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a51c92-fa40-41d9-9b3a-6f02d694d3eb req-94526046-7bbe-43f3-9e07-4280529f4f6f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:53.850075 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-32a51c92-fa40-41d9-9b3a-6f02d694d3eb req-94526046-7bbe-43f3-9e07-4280529f4f6f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1443331
Jun 01 11:09:53.949756 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:53.956637 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-32a51c92-fa40-41d9-9b3a-6f02d694d3eb req-f47aff6d-7db8-419b-9f57-207172fa0995 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1003535
Jun 01 11:09:54.035284 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f2cdf12-e4a0-4787-9c9c-bd71916663c7 x-openstack-request-id: req-9f2cdf12-e4a0-4787-9c9c-bd71916663c7 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:54.035615 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2", "tag": "c4a9498c-cfd5-4c11-ba25-e4985d580263", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:54.035905 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-9f2cdf12-e4a0-4787-9c9c-bd71916663c7 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:54.036382 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'tag': 'c4a9498c-cfd5-4c11-ba25-e4985d580263', 'status': 'completed', 'code': 200}
Jun 01 11:09:54.223439 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d68dcf-3899-4a5b-a093-67674244a653 req-8341e710-4d7c-41af-a465-61d298e6c80c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:54.225634 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-42d68dcf-3899-4a5b-a093-67674244a653 req-8341e710-4d7c-41af-a465-61d298e6c80c service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 1098 time: 0.1439080
Jun 01 11:09:54.302325 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967f8ba2-4afd-4d22-84d2-8f81e984fda1 req-27fce9e9-8c78-46a0-bad6-763d6519a314 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:54.303910 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-967f8ba2-4afd-4d22-84d2-8f81e984fda1 req-27fce9e9-8c78-46a0-bad6-763d6519a314 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2082584
Jun 01 11:09:54.315265 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58816) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:54.327083 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-e588553c-1c1a-446e-b405-804701c5490d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'floatingip': {'port_id': '6c613458-8891-4e54-aa10-4a7743587916'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:09:54.433939 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e588553c-1c1a-446e-b405-804701c5490d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:54.532415 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d68dcf-3899-4a5b-a093-67674244a653 req-214992b4-18ad-4215-a2b6-6a3749c7affc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:54.534768 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-42d68dcf-3899-4a5b-a093-67674244a653 req-214992b4-18ad-4215-a2b6-6a3749c7affc service neutron] 10.222.0.79 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 911 time: 0.3002775
Jun 01 11:09:54.646233 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579910e8b0>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '78d6aaef-834f-4604-a6cb-fec4c348d4e0', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'floating_ip_address': '172.27.3.86', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'port_id': 'c4a9498c-cfd5-4c11-ba25-e4985d580263', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 144, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'mac_address': 'fa:16:3e:5d:c0:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:09:17Z', 'updated_at': '2021-06-01T11:09:52Z', 'revision_number': 1, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:54.656681 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] Checking router: abf03e4b-fdd0-44b3-86be-277da7892b4a for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:09:54.677344 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-42d68dcf-3899-4a5b-a093-67674244a653 req-52233544-5501-4e01-8d89-caa0a4abfa12 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263 HTTP/1.1" status: 200  len: 998 time: 0.1355278
Jun 01 11:09:54.684467 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:54.686335 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579910e8b0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:09:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:54.849880 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d68dcf-3899-4a5b-a093-67674244a653 req-e14344bb-1edc-4706-98be-b3f3b980a2fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:54.851313 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-42d68dcf-3899-4a5b-a093-67674244a653 req-e14344bb-1edc-4706-98be-b3f3b980a2fb service neutron] 10.222.0.79 "GET /v2.0/subnets?id=08c4a15d-0d06-4d4b-909f-10ac28c5c16c HTTP/1.1" status: 200  len: 849 time: 0.1647801
Jun 01 11:09:54.874198 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e17923-a6d9-408b-9911-0de768ef2e1b req-45d94526-77e9-45f2-8e0d-a4896146fddf tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:54.885596 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b0e17923-a6d9-408b-9911-0de768ef2e1b req-45d94526-77e9-45f2-8e0d-a4896146fddf tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.3621080
Jun 01 11:09:54.968116 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:54.969993 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d68dcf-3899-4a5b-a093-67674244a653 req-14d9a3c5-3e14-42dc-83f5-49eff1dfb886 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:54.972270 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-42d68dcf-3899-4a5b-a093-67674244a653 req-14d9a3c5-3e14-42dc-83f5-49eff1dfb886 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=418faffe-faca-4025-ab0f-56771435263e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1014366
Jun 01 11:09:55.040177 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b0e17923-a6d9-408b-9911-0de768ef2e1b req-a7599f8a-af6d-4f33-9c3b-131e087903c1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1536188
Jun 01 11:09:55.149278 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-42d68dcf-3899-4a5b-a093-67674244a653 req-0571f58d-0459-426a-9e73-97b034b9c1c6 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1695406
Jun 01 11:09:55.193083 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd939691-40ea-49ed-af36-6573ae01d99a req-d758c83c-e70b-407d-9110-f775935ec08f tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:55.202585 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd939691-40ea-49ed-af36-6573ae01d99a req-d758c83c-e70b-407d-9110-f775935ec08f tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.3888800
Jun 01 11:09:55.246858 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-cef9336e-a8fb-4b6f-9f25-5bb4a6d46ee9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:55.299968 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd939691-40ea-49ed-af36-6573ae01d99a req-007729fd-8530-494b-891a-f49acc233a99 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0959845
Jun 01 11:09:55.328210 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:55.409631 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-42d68dcf-3899-4a5b-a093-67674244a653 req-d3d4b784-8e3e-465f-829c-3a95f484364a service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2454555
Jun 01 11:09:55.574749 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579910e8b0>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '78d6aaef-834f-4604-a6cb-fec4c348d4e0', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'floating_ip_address': '172.27.3.86', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'port_id': 'c4a9498c-cfd5-4c11-ba25-e4985d580263', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 144, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'mac_address': 'fa:16:3e:5d:c0:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:09:17Z', 'updated_at': '2021-06-01T11:09:52Z', 'revision_number': 1, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:55.580981 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72472cc9-f242-45d0-8d37-1588cf2ac80c None None] The sync data for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi is: [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '78d6aaef-834f-4604-a6cb-fec4c348d4e0', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'floating_ip_address': '172.27.3.86', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'port_id': 'c4a9498c-cfd5-4c11-ba25-e4985d580263', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 144, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'mac_address': 'fa:16:3e:5d:c0:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:09:17Z', 'updated_at': '2021-06-01T11:09:52Z', 'revision_number': 1, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:09:55.636150 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e588553c-1c1a-446e-b405-804701c5490d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:55.645549 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e588553c-1c1a-446e-b405-804701c5490d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:55.906578 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fcaf405-0ae8-4239-a74e-ce46ce4febcb None None] New status for floating IP 78d6aaef-834f-4604-a6cb-fec4c348d4e0: ACTIVE {{(pid=119242) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:09:56.034988 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-f9e94c2a-146c-4697-b33a-3d7f0f907c4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:56.037937 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-f9e94c2a-146c-4697-b33a-3d7f0f907c4e service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 1098 time: 0.1105278
Jun 01 11:09:56.045680 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [None req-e588553c-1c1a-446e-b405-804701c5490d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Floating IP 898b31c3-a1df-4302-b729-ff58b2760871 associated. External IP: 172.27.3.155, port: 6c613458-8891-4e54-aa10-4a7743587916.
Jun 01 11:09:56.215677 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e53012-fdbc-473c-89d2-bebd2f82a953 req-072be404-a8a4-4a62-92ee-8c1a8dad9b54 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:56.217432 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-66e53012-fdbc-473c-89d2-bebd2f82a953 req-072be404-a8a4-4a62-92ee-8c1a8dad9b54 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.2577009
Jun 01 11:09:56.224711 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-f169e3d8-8c52-4370-bca7-bf9d64dc8767 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:56.226384 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-f169e3d8-8c52-4370-bca7-bf9d64dc8767 service neutron] 10.222.0.79 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 919 time: 0.1808882
Jun 01 11:09:56.293202 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-66e53012-fdbc-473c-89d2-bebd2f82a953 req-664cf8b5-4c4a-415c-9a37-25ac7cee743e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0678978
Jun 01 11:09:56.312033 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-00fbe709-a94f-499b-9244-6dd31adcd4d3 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=9f011433-de88-40d6-a527-c916faeb6339 HTTP/1.1" status: 200  len: 217 time: 0.0771422
Jun 01 11:09:56.379969 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:56.406544 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-cbcaafe7-e083-4353-8eff-d388420ef868 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:56.408013 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-cbcaafe7-e083-4353-8eff-d388420ef868 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 200  len: 858 time: 0.0888839
Jun 01 11:09:56.474627 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-19fcd174-a5e2-44b4-93f6-505fbf7d08a1 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=e8c7dea7-722b-446b-9e9f-d27643e48187&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0595374
Jun 01 11:09:56.561492 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e588553c-1c1a-446e-b405-804701c5490d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Router 27b3b506-6634-49e2-b666-8f59cfd9cf96 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:09:56.643770 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd1d018c-9c8a-4fda-b314-0cb9d506b1c0 req-0e6ab33a-4065-4065-a50f-5a292f3146de tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:56.645276 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd1d018c-9c8a-4fda-b314-0cb9d506b1c0 req-0e6ab33a-4065-4065-a50f-5a292f3146de tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.1891496
Jun 01 11:09:56.704989 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-0ebc3bd5-2d4b-4864-a855-9b7673991254 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2097518
Jun 01 11:09:56.797739 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58890) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:56.813753 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd1d018c-9c8a-4fda-b314-0cb9d506b1c0 req-d1c9d0f9-84c0-41fa-b454-492655111430 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1489258
Jun 01 11:09:56.833727 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e588553c-1c1a-446e-b405-804701c5490d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:09:56.838210 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e588553c-1c1a-446e-b405-804701c5490d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:56.846931 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] Sync routers for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:09:56.856406 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:56.858037 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579906a730>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:09:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:56.886971 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-b779dfc4-b06f-40bd-8be5-f3a25cb5a728 req-636f4773-a54c-4224-a225-3832c182f779 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1766331
Jun 01 11:09:56.910344 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-e588553c-1c1a-446e-b405-804701c5490d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "PUT /v2.0/floatingips/898b31c3-a1df-4302-b729-ff58b2760871 HTTP/1.1" status: 200  len: 991 time: 2.5937591
Jun 01 11:09:56.911139 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'tag': '6c613458-8891-4e54-aa10-4a7743587916'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:56.914327 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088" -d '{"events": [{"name": "network-changed", "server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "tag": "6c613458-8891-4e54-aa10-4a7743587916"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:56.964599 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00c9b47a-6568-4aa3-87d7-9eed9e20481c x-openstack-request-id: req-00c9b47a-6568-4aa3-87d7-9eed9e20481c {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:56.964918 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "tag": "6c613458-8891-4e54-aa10-4a7743587916", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:56.965195 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-00c9b47a-6568-4aa3-87d7-9eed9e20481c {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:56.965791 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'tag': '6c613458-8891-4e54-aa10-4a7743587916', 'status': 'completed', 'code': 200}
Jun 01 11:09:56.997160 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:57.014721 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:57.018880 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Usage tracker for resource:security_group_rule and tenant:c946d1c3e20e48ea97ca79eaa1cd844f is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:57.021999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:57.027997 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:57.079107 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-ec985784-8b40-4350-9c8e-098ce3dbe2ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:57.081028 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-ec985784-8b40-4350-9c8e-098ce3dbe2ca service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 1098 time: 0.0786066
Jun 01 11:09:57.104744 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:57.131025 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:57.136468 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:57.152279 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1098c185-450f-4e92-9c1a-1d5bfdbcc7dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:57.198097 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=c946d1c3e20e48ea97ca79eaa1cd844f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3989482
Jun 01 11:09:57.200492 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58902) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:57.211674 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a884413-1ee7-4a1b-a940-9bd94c2d44df,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:57.216908 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:57.225549 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-7db94736-1592-41f5-8bf4-f3ca96598d66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:57.227066 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-7db94736-1592-41f5-8bf4-f3ca96598d66 service neutron] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 917 time: 0.1368794
Jun 01 11:09:57.267060 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-38a887f8-eb9a-40bc-b0c9-e3ec8efcd059 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:57.300301 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-38a887f8-eb9a-40bc-b0c9-e3ec8efcd059 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:57.340611 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-a0cb0167-66cb-4e57-b6b3-76dc684e50e6 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=6c613458-8891-4e54-aa10-4a7743587916 HTTP/1.1" status: 200  len: 999 time: 0.1042767
Jun 01 11:09:57.360287 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-38a887f8-eb9a-40bc-b0c9-e3ec8efcd059 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:57.366498 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c2e209de-eb56-44fa-8e53-4c847bce4316 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:57.379953 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a887f8-eb9a-40bc-b0c9-e3ec8efcd059 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a884413-1ee7-4a1b-a940-9bd94c2d44df,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:57.383355 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-38a887f8-eb9a-40bc-b0c9-e3ec8efcd059 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:57.384315 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-38a887f8-eb9a-40bc-b0c9-e3ec8efcd059 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:57.385434 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-38a887f8-eb9a-40bc-b0c9-e3ec8efcd059 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/1a884413-1ee7-4a1b-a940-9bd94c2d44df HTTP/1.1" status: 204  len: 168 time: 0.1839945
Jun 01 11:09:57.517271 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579906a730>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '898b31c3-a1df-4302-b729-ff58b2760871', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'floating_ip_address': '172.27.3.155', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'port_id': '6c613458-8891-4e54-aa10-4a7743587916', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 141, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'mac_address': 'fa:16:3e:c8:58:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:09:14Z', 'updated_at': '2021-06-01T11:09:55Z', 'revision_number': 1, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:57.532760 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] Checking router: 27b3b506-6634-49e2-b666-8f59cfd9cf96 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:09:57.535034 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3444d417-35cd-403f-b3e8-d40ac17ccbea req-fdc33388-be76-4d91-ba3e-1c357f521dcf tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:57.538577 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3444d417-35cd-403f-b3e8-d40ac17ccbea req-fdc33388-be76-4d91-ba3e-1c357f521dcf tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1101537
Jun 01 11:09:57.563411 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:09:57.564079 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579906a730>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:09:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:57.594743 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3444d417-35cd-403f-b3e8-d40ac17ccbea req-fc213b8a-c847-4be0-a53d-71ee5c2df712 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475252
Jun 01 11:09:57.599719 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-65c05388-d015-47b8-8d9c-118a93edadde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:57.601142 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-65c05388-d015-47b8-8d9c-118a93edadde service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.2405257
Jun 01 11:09:57.623325 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-e1359b0c-0e28-44fb-9253-35d2dbb22ad8 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:57.624865 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-e1359b0c-0e28-44fb-9253-35d2dbb22ad8 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.79 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.1969280
Jun 01 11:09:57.737175 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:57.793398 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:09:57.834408 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58920) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:57.859654 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-597db9c5-db68-4456-a18a-ec79061a8cb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:57.861978 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-597db9c5-db68-4456-a18a-ec79061a8cb6 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2361722
Jun 01 11:09:57.866065 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:57.896225 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:09:57.909271 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Usage tracker for resource:security_group_rule and tenant:4ff2d23e136d46fa92f0cbe279c47ec3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:09:57.916398 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:09:57.933406 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:09:58.024348 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Deleting port c568e1a6-7392-470c-80fa-8943b8cc84b5 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:09:58.024707 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.120323 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-c5ba0d1e-a7d4-47b3-97da-44afcb5aeb27 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2398136
Jun 01 11:09:58.147726 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.158048 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.196177 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-371d6421-6891-49e0-8b7e-420d168d8382 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:58.209043 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=4ff2d23e136d46fa92f0cbe279c47ec3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3735662
Jun 01 11:09:58.209701 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 58936) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:09:58.276202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08335071-4a75-4c57-a0ba-876c823cadc3 req-ca62eeda-28b8-4a10-850c-8e3560f7ae0c tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:58.278599 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-08335071-4a75-4c57-a0ba-876c823cadc3 req-ca62eeda-28b8-4a10-850c-8e3560f7ae0c tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 945 time: 0.2665660
Jun 01 11:09:58.295691 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cd7c90a-3104-4ce8-9dc4-80ad9f10576e,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:58.299977 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:58.311738 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-dbb76364-0952-4dfb-9ae2-b8a7cbe2e088 req-a28984a7-9873-4561-b5ce-fd06a1e6f690 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1786044
Jun 01 11:09:58.358082 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-08335071-4a75-4c57-a0ba-876c823cadc3 req-41008988-e8a6-476a-8a04-cf8a9ba6626d tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/security-groups?id=b1074cba-4e35-4346-aa70-e3bc340cdc99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0673079
Jun 01 11:09:58.370465 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] For port c568e1a6-7392-470c-80fa-8943b8cc84b5, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c568e1a6-7392-470c-80fa-8943b8cc84b5,segment=NetworkSegment(989f88ce-9ed9-4d44-aabd-f14b3be6c3d4),segment_id=989f88ce-9ed9-4d44-aabd-f14b3be6c3d4)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:09:58.370897 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.382305 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0cbaf902-2edd-431a-9e3b-300a34bd5d50 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.423513 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579906a730>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '898b31c3-a1df-4302-b729-ff58b2760871', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'floating_ip_address': '172.27.3.155', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'port_id': '6c613458-8891-4e54-aa10-4a7743587916', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 141, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'mac_address': 'fa:16:3e:c8:58:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:09:14Z', 'updated_at': '2021-06-01T11:09:55Z', 'revision_number': 1, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:09:58.430810 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0cbaf902-2edd-431a-9e3b-300a34bd5d50 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.439794 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0b33f47-78c4-4583-bfad-b880ab3791aa None None] The sync data for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi is: [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '898b31c3-a1df-4302-b729-ff58b2760871', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'floating_ip_address': '172.27.3.155', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'port_id': '6c613458-8891-4e54-aa10-4a7743587916', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 141, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'mac_address': 'fa:16:3e:c8:58:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:09:14Z', 'updated_at': '2021-06-01T11:09:55Z', 'revision_number': 1, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:09:58.507560 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Calling delete_port for c568e1a6-7392-470c-80fa-8943b8cc84b5 owned by compute:nova {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:09:58.606265 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0cbaf902-2edd-431a-9e3b-300a34bd5d50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.611806 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-153ea82d-d4e1-4f47-aa7f-54d782d1170c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:58.633140 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cbaf902-2edd-431a-9e3b-300a34bd5d50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cd7c90a-3104-4ce8-9dc4-80ad9f10576e,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:58.642020 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0cbaf902-2edd-431a-9e3b-300a34bd5d50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:58.643302 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0cbaf902-2edd-431a-9e3b-300a34bd5d50 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.644451 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0cbaf902-2edd-431a-9e3b-300a34bd5d50 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/7cd7c90a-3104-4ce8-9dc4-80ad9f10576e HTTP/1.1" status: 204  len: 168 time: 0.4304707
Jun 01 11:09:58.714902 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-278672fe-302c-4062-99b0-0e65a3621fa9 None None] New status for floating IP 898b31c3-a1df-4302-b729-ff58b2760871: ACTIVE {{(pid=119242) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:09:58.717843 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.733339 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f930e143-f510-48fa-852d-3887b7521abb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:09:58.848171 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['c568e1a6-7392-470c-80fa-8943b8cc84b5'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:09:58.887344 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Pushing event deleted for resources: {'Port': ['ID=c568e1a6-7392-470c-80fa-8943b8cc84b5,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:09:58.901852 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:09:58.944672 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a499969-22a5-4626-a94f-26746c0ff262 req-3319718d-a908-4fc4-bf7e-6007bbc71ecd tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:09:58.946645 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a499969-22a5-4626-a94f-26746c0ff262 req-3319718d-a908-4fc4-bf7e-6007bbc71ecd tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1462746
Jun 01 11:09:58.959863 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] No DVR routers for this DVR port c568e1a6-7392-470c-80fa-8943b8cc84b5 on host hv-cinder-78776 {{(pid=119240) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:09:58.963855 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:09:58.967014 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '30bbda88-b979-4b36-bafb-eb3ae5baa20b', 'name': 'network-vif-deleted', 'tag': 'c568e1a6-7392-470c-80fa-8943b8cc84b5'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:09:58.971299 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b575ebb-88ed-441d-be6a-107ec2b28f05" -d '{"events": [{"server_uuid": "30bbda88-b979-4b36-bafb-eb3ae5baa20b", "name": "network-vif-deleted", "tag": "c568e1a6-7392-470c-80fa-8943b8cc84b5"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:09:58.991852 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c4457184-b62d-4b41-968e-2320fd5cb5ec req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.79 "DELETE /v2.0/ports/c568e1a6-7392-470c-80fa-8943b8cc84b5 HTTP/1.1" status: 204  len: 173 time: 1.3231132
Jun 01 11:09:58.998918 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a499969-22a5-4626-a94f-26746c0ff262 req-52da2bd3-073f-4254-bd83-2756200b3c2a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455551
Jun 01 11:09:59.077015 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:09:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71965c06-23b4-42ef-b1a7-248357906432 x-openstack-request-id: req-71965c06-23b4-42ef-b1a7-248357906432 {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:09:59.083765 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "30bbda88-b979-4b36-bafb-eb3ae5baa20b", "name": "network-vif-deleted", "tag": "c568e1a6-7392-470c-80fa-8943b8cc84b5", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:09:59.083765 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-71965c06-23b4-42ef-b1a7-248357906432 {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:09:59.083765 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '30bbda88-b979-4b36-bafb-eb3ae5baa20b', 'name': 'network-vif-deleted', 'tag': 'c568e1a6-7392-470c-80fa-8943b8cc84b5', 'status': 'completed', 'code': 200}
Jun 01 11:10:00.321591 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c7b124a4-7e46-4105-aebb-60da62399507 req-5bec255c-75ff-44c1-8aeb-9217381ea1e9 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.0486054
Jun 01 11:10:00.500513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9ca983-fbe4-43e7-880e-2bd896c5b8af req-e3fc81c1-fe56-4fae-904f-9e3bf3683480 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:00.501965 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ab9ca983-fbe4-43e7-880e-2bd896c5b8af req-e3fc81c1-fe56-4fae-904f-9e3bf3683480 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0860820
Jun 01 11:10:00.546349 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ab9ca983-fbe4-43e7-880e-2bd896c5b8af req-0a757a79-6798-4461-b1f9-bb5d7a079d17 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384488
Jun 01 11:10:02.471186 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a04e6f03-8427-40af-a178-ec6f4160bef7 req-9e843338-1c90-4065-bed5-62bb5abae17e tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.0476782
Jun 01 11:10:02.475234 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c568e1a6-7392-470c-80fa-8943b8cc84b5 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:10:02.510857 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: c568e1a6-7392-470c-80fa-8943b8cc84b5 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:10:02.511296 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c568e1a6-7392-470c-80fa-8943b8cc84b5 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:10:02.550646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bde8cc-cafd-4fc5-bf03-6c47dde8ae25 req-5b0d10a9-b166-47f1-ac1f-45225f962cdc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:02.552125 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-84bde8cc-cafd-4fc5-bf03-6c47dde8ae25 req-5b0d10a9-b166-47f1-ac1f-45225f962cdc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0835929
Jun 01 11:10:02.596140 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-84bde8cc-cafd-4fc5-bf03-6c47dde8ae25 req-8bee699b-9cf1-4599-bbca-16dfa7d9983d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383496
Jun 01 11:10:04.802891 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:10:06.203563 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e4373ea4-6f8d-4715-aa11-4b0599eb4b16 req-4b08dc1b-f9dc-4254-b21d-8efca1a1a1eb tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.0799870
Jun 01 11:10:06.244595 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd85cf7-774d-4f0e-9843-35118f4d3b9a req-d2814fc5-7fa2-4c0e-a95a-9d166ecc93ec tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:06.246000 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ddd85cf7-774d-4f0e-9843-35118f4d3b9a req-d2814fc5-7fa2-4c0e-a95a-9d166ecc93ec tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0907819
Jun 01 11:10:06.291995 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ddd85cf7-774d-4f0e-9843-35118f4d3b9a req-d49ac778-d634-4e37-94ba-a03480613bda tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403674
Jun 01 11:10:07.500573 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0eb81549-4cab-4b58-ada8-08f493d6a74f req-9f195b41-c26f-4289-8ed3-6aa9da0e2475 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] 10.222.0.74 "GET /v2.0/ports?device_id=30bbda88-b979-4b36-bafb-eb3ae5baa20b HTTP/1.1" status: 200  len: 210 time: 0.1207788
Jun 01 11:10:07.538912 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9cf17f4-062a-475b-b2bf-f8db3cdff51a req-ea6565f7-aa56-4755-a458-88c4916eaf05 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:07.540376 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c9cf17f4-062a-475b-b2bf-f8db3cdff51a req-ea6565f7-aa56-4755-a458-88c4916eaf05 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0925379
Jun 01 11:10:07.584801 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c9cf17f4-062a-475b-b2bf-f8db3cdff51a req-0f9cdeaa-4119-4fa2-a06f-1b75b6d6925b tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387013
Jun 01 11:10:08.814868 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-284310cf-4c28-4afe-984f-2d4b4d854a6e req-2d73a71d-d484-459e-8d40-122d6670fda1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:08.817181 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-284310cf-4c28-4afe-984f-2d4b4d854a6e req-2d73a71d-d484-459e-8d40-122d6670fda1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0988939
Jun 01 11:10:08.868153 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-284310cf-4c28-4afe-984f-2d4b4d854a6e req-30d1ab87-37a3-4901-8898-bd19e7dab867 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0452468
Jun 01 11:10:10.071150 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae77ec62-b9e0-49e9-a6de-2d127e1ebb17 req-ed20edc2-577b-4385-8422-f8917c4320de tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:10.072655 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ae77ec62-b9e0-49e9-a6de-2d127e1ebb17 req-ed20edc2-577b-4385-8422-f8917c4320de tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0870907
Jun 01 11:10:10.123958 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ae77ec62-b9e0-49e9-a6de-2d127e1ebb17 req-ed571d11-1ce2-4d40-80cf-af5f0fd5106c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447643
Jun 01 11:10:10.796398 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59218) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:10.855063 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_v2 [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] Deleting subnet 4244194d-2962-4661-95dd-d3f879a92c43 {{(pid=119241) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:10:10.858570 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:10.906247 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10844045'] for subnet, precommit_delete_associations {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:10.962538 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.208551 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10882836', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10623430'] for subnet, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.214169 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3b90d6f3-51cc-49dd-813e-01d72dc10af5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:11.292580 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4244194d-2962-4661-95dd-d3f879a92c43,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:11.308746 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.326707 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59230) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:11.327278 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/4244194d-2962-4661-95dd-d3f879a92c43 HTTP/1.1" status: 204  len: 168 time: 0.5293322
Jun 01 11:10:11.335778 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:11.374234 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4570b1-0830-4579-8a01-658d6f65f7e9 req-e59207e2-18e6-4ed3-b6da-1c692661450e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:11.375806 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd4570b1-0830-4579-8a01-658d6f65f7e9 req-e59207e2-18e6-4ed3-b6da-1c692661450e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1302774
Jun 01 11:10:11.421066 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd4570b1-0830-4579-8a01-658d6f65f7e9 req-2cd8c68b-dfc1-4853-8013-25a1d6db9645 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397756
Jun 01 11:10:11.442841 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.617389 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.632086 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f57937f6400>,) {'filters': {'network_id': ['16003d7c-7204-44bb-9e84-543e6390b879']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:10:11.648779 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f57937f6400>, '989f88ce-9ed9-4d44-aabd-f14b3be6c3d4') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:10:11.649076 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f57937f6400>, '989f88ce-9ed9-4d44-aabd-f14b3be6c3d4') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:10:11.663087 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.672678 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-98a3442f-333e-43e0-acde-30cd70d160bc service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1902862
Jun 01 11:10:11.693553 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.707555 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Releasing vlan 660 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:10:11.708138 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:10:11.723502 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:10:11.939050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.948638 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:11.954159 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6cae0954-81d1-4c7f-909c-1423bba23236 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:11.976549 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Pushing event deleted for resources: {'Network': ['ID=16003d7c-7204-44bb-9e84-543e6390b879,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:11.979569 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:11.982885 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-ca01fe56-f37f-42f6-a969-700c7d1fbc4f admin admin] 10.222.0.74 "DELETE /v2.0/networks/16003d7c-7204-44bb-9e84-543e6390b879 HTTP/1.1" status: 204  len: 168 time: 0.6541333
Jun 01 11:10:12.002697 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-9339af33-e5ca-41f7-bc46-0b457f23dbc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:12.004198 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-9339af33-e5ca-41f7-bc46-0b457f23dbc5 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1099 time: 0.1431062
Jun 01 11:10:12.180370 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-23882d82-94b7-425c-999f-e586b956bc0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:12.182028 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-23882d82-94b7-425c-999f-e586b956bc0e service neutron] 10.222.0.79 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 919 time: 0.1505053
Jun 01 11:10:12.202723 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59254) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:12.253791 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-84168508-3141-40a3-bf6b-5043e94cbeb3 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24 HTTP/1.1" status: 200  len: 217 time: 0.0638990
Jun 01 11:10:12.266724 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-899d5c78-7187-491c-8342-7dae36ee77e2 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=0575695b945b453b9737182f6235cbe5&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0618396
Jun 01 11:10:12.269238 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59260) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:12.333325 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-5e7f87c0-8b78-4c5d-a353-d5af067244e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:12.334822 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-5e7f87c0-8b78-4c5d-a353-d5af067244e2 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 200  len: 858 time: 0.0746081
Jun 01 11:10:12.352801 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-471679fd-dd7d-4587-a526-1e012131e433 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:12.379859 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-471679fd-dd7d-4587-a526-1e012131e433 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:12.409742 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-ea5a0313-dfd0-45f6-8f4a-db615098d850 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=e8c7dea7-722b-446b-9e9f-d27643e48187&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0602984
Jun 01 11:10:12.450488 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-471679fd-dd7d-4587-a526-1e012131e433 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:12.456083 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-38a887f8-eb9a-40bc-b0c9-e3ec8efcd059 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:12.469574 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471679fd-dd7d-4587-a526-1e012131e433 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1074cba-4e35-4346-aa70-e3bc340cdc99,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:12.472733 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-471679fd-dd7d-4587-a526-1e012131e433 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:12.476574 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-471679fd-dd7d-4587-a526-1e012131e433 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:12.478692 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-471679fd-dd7d-4587-a526-1e012131e433 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/b1074cba-4e35-4346-aa70-e3bc340cdc99 HTTP/1.1" status: 204  len: 168 time: 0.2080133
Jun 01 11:10:12.575005 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-3e1df3f3-0c40-4853-8d39-db5b4d128ebf service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1562324
Jun 01 11:10:12.641224 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d45d8deb-257b-4a79-be99-e55f2811d7a8 req-411ab11e-c13b-43d8-9332-36b8d6144b53 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:12.642923 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d45d8deb-257b-4a79-be99-e55f2811d7a8 req-411ab11e-c13b-43d8-9332-36b8d6144b53 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0812714
Jun 01 11:10:12.726133 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-0c876d23-edd6-48b9-b3ba-75fa7bc44fc5 req-dfef6b3f-e1f8-4134-a9cb-80c70cbffc9e service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1428609
Jun 01 11:10:12.772287 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d45d8deb-257b-4a79-be99-e55f2811d7a8 req-3335469f-f919-4a46-ba24-bb2232b31c99 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1226008
Jun 01 11:10:13.969958 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ee0783-675f-44b9-936b-08820f088790 req-adcd0733-1e95-4023-85ce-fb0f64ea618a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:13.972367 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e5ee0783-675f-44b9-936b-08820f088790 req-adcd0733-1e95-4023-85ce-fb0f64ea618a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0813057
Jun 01 11:10:14.026024 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e5ee0783-675f-44b9-936b-08820f088790 req-ec09c3b1-479a-43d5-833e-e3dd09d7b759 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469141
Jun 01 11:10:14.544982 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59356) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:14.603123 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59364) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:14.759515 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:14.769531 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:14.785851 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:14.791072 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Usage tracker for resource:security_group_rule and tenant:0979ef09c70f48bea89158b7440eee1a is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:14.795573 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:14.797687 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:14.804053 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Usage tracker for resource:security_group_rule and tenant:884131d0af3448e09f6d8037511ff1e3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:14.806647 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:14.808660 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:14.816279 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:14.953887 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:14.959980 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:14.969511 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:14.970404 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f81825e1-ef6b-46f1-948b-92419d012c2b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:14.982225 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.026611 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=0979ef09c70f48bea89158b7440eee1a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4202023
Jun 01 11:10:15.029749 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59374) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:15.030553 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97d4e503-0d8f-43da-92ff-e9e30112c2f5,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:15.035490 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:15.035990 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c790a055-9968-431e-9dbc-98a1aaa8ff83 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.043s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:15.048635 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=884131d0af3448e09f6d8037511ff1e3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5023561
Jun 01 11:10:15.051286 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59380) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:15.089572 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3df45d90-ff25-44c8-9afe-51057209046c,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:15.089935 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0ff5bad5-4600-4952-9c8f-5c16c4d7ac9d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.095387 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:15.127770 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0ff5bad5-4600-4952-9c8f-5c16c4d7ac9d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.137299 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7c29c50f-ee5e-4409-aa06-57d56d77ded3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.181006 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0ff5bad5-4600-4952-9c8f-5c16c4d7ac9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.187221 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:15.199882 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ff5bad5-4600-4952-9c8f-5c16c4d7ac9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97d4e503-0d8f-43da-92ff-e9e30112c2f5,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:15.202757 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0ff5bad5-4600-4952-9c8f-5c16c4d7ac9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:15.205090 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7c29c50f-ee5e-4409-aa06-57d56d77ded3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.205613 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0ff5bad5-4600-4952-9c8f-5c16c4d7ac9d admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.206727 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-0ff5bad5-4600-4952-9c8f-5c16c4d7ac9d admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/97d4e503-0d8f-43da-92ff-e9e30112c2f5 HTTP/1.1" status: 204  len: 168 time: 0.1760244
Jun 01 11:10:15.250612 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.280079 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50a91bca-5339-40b8-94be-31240d3fca53 req-89387248-0b36-465d-b4cc-78b850204615 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:15.281669 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-50a91bca-5339-40b8-94be-31240d3fca53 req-89387248-0b36-465d-b4cc-78b850204615 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1341424
Jun 01 11:10:15.305453 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7c29c50f-ee5e-4409-aa06-57d56d77ded3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.311618 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:15.335495 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c29c50f-ee5e-4409-aa06-57d56d77ded3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3df45d90-ff25-44c8-9afe-51057209046c,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:15.341068 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7c29c50f-ee5e-4409-aa06-57d56d77ded3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:15.351549 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7c29c50f-ee5e-4409-aa06-57d56d77ded3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.355096 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-7c29c50f-ee5e-4409-aa06-57d56d77ded3 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/3df45d90-ff25-44c8-9afe-51057209046c HTTP/1.1" status: 204  len: 168 time: 0.2999554
Jun 01 11:10:15.355485 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-50a91bca-5339-40b8-94be-31240d3fca53 req-799a1993-888b-40c8-8aa3-c53792a4b764 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0662236
Jun 01 11:10:15.530942 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59392) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:15.548889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.563572 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:15.567402 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Usage tracker for resource:security_group_rule and tenant:7df0531771fd424fa4c0843307103da0 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:15.570216 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:15.576513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:15.661341 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.665465 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.674624 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d87f7530-fd26-47f3-ac5c-4d6d999ea5dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:15.717673 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=7df0531771fd424fa4c0843307103da0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1852210
Jun 01 11:10:15.718749 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f534946-a9fe-42fd-9b7c-0bfe52760bff,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:15.720156 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59402) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:15.734311 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:15.755571 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59406) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:15.777894 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.790929 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1266eee7-a324-4167-baf6-2bb1dcc511d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.797484 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:15.801516 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Usage tracker for resource:security_group_rule and tenant:225dbac7d222437b8d762868a59314f8 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:15.804360 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:15.810772 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:15.827249 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1266eee7-a324-4167-baf6-2bb1dcc511d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.881972 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1266eee7-a324-4167-baf6-2bb1dcc511d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.886798 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:15.899836 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1266eee7-a324-4167-baf6-2bb1dcc511d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f534946-a9fe-42fd-9b7c-0bfe52760bff,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:15.900030 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.902821 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1266eee7-a324-4167-baf6-2bb1dcc511d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:15.903821 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1266eee7-a324-4167-baf6-2bb1dcc511d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.903971 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:15.907573 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-1266eee7-a324-4167-baf6-2bb1dcc511d2 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/9f534946-a9fe-42fd-9b7c-0bfe52760bff HTTP/1.1" status: 204  len: 168 time: 0.1863849
Jun 01 11:10:15.917122 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c1630ac4-40fc-45d4-8dc4-1dd5909ecf1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:15.958430 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=225dbac7d222437b8d762868a59314f8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2017655
Jun 01 11:10:15.959333 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ab0bda8-b6d8-4c47-80c9-6ea0f9673969,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:15.961136 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59414) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:15.962356 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:16.023042 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e2526aef-ee75-49e2-84d9-e05cbcb8711d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:16.048495 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e2526aef-ee75-49e2-84d9-e05cbcb8711d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:16.100481 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e2526aef-ee75-49e2-84d9-e05cbcb8711d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:16.105757 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0ff5bad5-4600-4952-9c8f-5c16c4d7ac9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:16.116567 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2526aef-ee75-49e2-84d9-e05cbcb8711d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ab0bda8-b6d8-4c47-80c9-6ea0f9673969,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:16.120300 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e2526aef-ee75-49e2-84d9-e05cbcb8711d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:16.123500 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e2526aef-ee75-49e2-84d9-e05cbcb8711d admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:16.124684 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e2526aef-ee75-49e2-84d9-e05cbcb8711d admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/8ab0bda8-b6d8-4c47-80c9-6ea0f9673969 HTTP/1.1" status: 204  len: 168 time: 0.1623960
Jun 01 11:10:17.506636 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38033251-fb65-41d3-956f-1e915ca0b600 req-533316d1-4ffd-443b-bc5b-03af2e8e9467 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:17.509272 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-38033251-fb65-41d3-956f-1e915ca0b600 req-533316d1-4ffd-443b-bc5b-03af2e8e9467 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0965791
Jun 01 11:10:17.568738 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-38033251-fb65-41d3-956f-1e915ca0b600 req-56dad1a0-d8a3-4383-b6f4-db9f08561a8e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513966
Jun 01 11:10:18.758577 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a5056f8-75a4-4db0-bc56-f3321f142687 req-a7efaba0-7d48-49f9-8648-1803822aa6a2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:18.760054 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3a5056f8-75a4-4db0-bc56-f3321f142687 req-a7efaba0-7d48-49f9-8648-1803822aa6a2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0852025
Jun 01 11:10:18.803434 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3a5056f8-75a4-4db0-bc56-f3321f142687 req-3e229632-4b68-447c-a385-2b7fd37ab417 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377412
Jun 01 11:10:20.020815 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3fa80fb-38ec-4d3a-a61b-d24b0e9ad7a0 req-9d6dbf24-78bc-46b0-a310-4fa479b3d1ef tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:20.028793 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c3fa80fb-38ec-4d3a-a61b-d24b0e9ad7a0 req-9d6dbf24-78bc-46b0-a310-4fa479b3d1ef tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1163826
Jun 01 11:10:20.084826 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c3fa80fb-38ec-4d3a-a61b-d24b0e9ad7a0 req-77fc9116-cfad-4ef6-9d9a-6f88890d9e4c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0551274
Jun 01 11:10:21.048133 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59648) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:21.175171 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.190022 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:21.193882 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Usage tracker for resource:security_group_rule and tenant:4dc6dac881f241e9a74ec2868800062d is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:21.197177 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:21.203606 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:21.279200 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9670a5d9-3cc7-4d9e-9541-b4796749a5c4 req-78139bf3-1438-4d73-abcc-830520a18f60 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:21.280929 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9670a5d9-3cc7-4d9e-9541-b4796749a5c4 req-78139bf3-1438-4d73-abcc-830520a18f60 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0859714
Jun 01 11:10:21.292927 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59662) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:21.308111 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.313738 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.322471 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:21.344838 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9670a5d9-3cc7-4d9e-9541-b4796749a5c4 req-62622447-1ed7-48f9-b105-b6bb630f37d7 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0568697
Jun 01 11:10:21.363398 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13dc5768-4052-4eb8-9a57-5ae9ed41e74d,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:21.367841 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:21.388667 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=4dc6dac881f241e9a74ec2868800062d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3364031
Jun 01 11:10:21.392234 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59672) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:21.474491 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.486119 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6c40f39a-7371-40bc-9125-35582c653e07 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.499806 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:21.507519 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Usage tracker for resource:security_group_rule and tenant:08a02ba0e4004a7ab46039638c95a4db is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:21.518127 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:21.524929 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:21.531564 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6c40f39a-7371-40bc-9125-35582c653e07 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.625790 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6c40f39a-7371-40bc-9125-35582c653e07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.641373 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0c88e93f-f543-44b0-abd4-ca821c562afd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:21.656873 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c40f39a-7371-40bc-9125-35582c653e07 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13dc5768-4052-4eb8-9a57-5ae9ed41e74d,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:21.659154 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6c40f39a-7371-40bc-9125-35582c653e07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:21.679533 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.681337 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6c40f39a-7371-40bc-9125-35582c653e07 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.682584 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6c40f39a-7371-40bc-9125-35582c653e07 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/13dc5768-4052-4eb8-9a57-5ae9ed41e74d HTTP/1.1" status: 204  len: 168 time: 0.2892439
Jun 01 11:10:21.688249 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.701532 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6499bbbf-7f9b-4b75-9873-337172ad2075 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:21.749024 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=08a02ba0e4004a7ab46039638c95a4db&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4545605
Jun 01 11:10:21.751318 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59698) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:21.754088 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=937f95f7-e4e9-4776-8aa6-d447401134b0,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:21.760383 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:21.861847 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-57133fb8-dbc1-44e9-9576-9104f339aaba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.900341 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-57133fb8-dbc1-44e9-9576-9104f339aaba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.971476 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-57133fb8-dbc1-44e9-9576-9104f339aaba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:21.980111 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c8eb58c4-dd6a-4326-82c3-e43b15868f59 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:21.995828 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57133fb8-dbc1-44e9-9576-9104f339aaba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=937f95f7-e4e9-4776-8aa6-d447401134b0,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:21.999728 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-57133fb8-dbc1-44e9-9576-9104f339aaba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:22.013055 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-57133fb8-dbc1-44e9-9576-9104f339aaba admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.016184 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-57133fb8-dbc1-44e9-9576-9104f339aaba admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/937f95f7-e4e9-4776-8aa6-d447401134b0 HTTP/1.1" status: 204  len: 168 time: 0.2634537
Jun 01 11:10:22.102709 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59726) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:22.121170 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.136903 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:22.143521 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Usage tracker for resource:security_group_rule and tenant:05341bd3a03e46eeb6ac4d409f441530 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:22.147076 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:22.154383 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:22.255889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.260922 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.271171 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:22.314536 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=05341bd3a03e46eeb6ac4d409f441530&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2107069
Jun 01 11:10:22.316217 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5c62dbe-cf11-4b40-89ba-ae075bdde658,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:22.317206 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59736) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:22.320733 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:22.385487 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59742) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:22.414263 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.430143 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59748) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:22.441470 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-83288757-29b3-433a-8596-92147f507c81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.443291 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:22.448363 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Usage tracker for resource:security_group_rule and tenant:b574490024ac45cfabed66744fd5d41e is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:22.452506 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:22.460029 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:22.499173 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-83288757-29b3-433a-8596-92147f507c81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.561525 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-83288757-29b3-433a-8596-92147f507c81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.567241 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e2526aef-ee75-49e2-84d9-e05cbcb8711d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:22.602303 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83288757-29b3-433a-8596-92147f507c81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5c62dbe-cf11-4b40-89ba-ae075bdde658,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:22.623124 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-83288757-29b3-433a-8596-92147f507c81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:22.624533 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-83288757-29b3-433a-8596-92147f507c81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.625222 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97c4866-54e1-41da-8b5a-36d8c3c816d7 req-026c59ff-4d70-4de1-9e7d-0146298a5d24 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:22.625930 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-83288757-29b3-433a-8596-92147f507c81 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/f5c62dbe-cf11-4b40-89ba-ae075bdde658 HTTP/1.1" status: 204  len: 168 time: 0.3070769
Jun 01 11:10:22.626741 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e97c4866-54e1-41da-8b5a-36d8c3c816d7 req-026c59ff-4d70-4de1-9e7d-0146298a5d24 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1405046
Jun 01 11:10:22.660478 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.672964 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.694361 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e58ac902-fcfc-4ddd-84cf-0fb1c939ed95 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:22.723380 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7d1e652a-79d6-498a-8c09-79fa865eca3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.777492 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=b574490024ac45cfabed66744fd5d41e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3882504
Jun 01 11:10:22.778428 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59762) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:22.779467 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.790702 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e97c4866-54e1-41da-8b5a-36d8c3c816d7 req-68fbbd7c-0775-455d-b11a-c6fa3c7359b5 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1531301
Jun 01 11:10:22.793881 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57db3338-038e-4a92-890f-20a03db768ad,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:22.797038 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:22.803024 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:22.807317 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Usage tracker for resource:security_group_rule and tenant:3d197dc8b48c496ca47a166e2c318544 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:22.811182 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:22.818287 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:22.866821 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e367bf46-b67d-4d70-8076-daae6bccd603 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.897805 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e367bf46-b67d-4d70-8076-daae6bccd603 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.919128 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.923426 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:22.959249 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-159487a4-7a2b-47c7-9c93-a4ac6330856e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:22.988494 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=3d197dc8b48c496ca47a166e2c318544&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5568621
Jun 01 11:10:22.991106 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59772) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:23.008756 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e367bf46-b67d-4d70-8076-daae6bccd603 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:23.018259 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:23.026261 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07492579-66bb-4c11-b558-c7d29c231e39,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:23.037205 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:23.065666 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e367bf46-b67d-4d70-8076-daae6bccd603 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57db3338-038e-4a92-890f-20a03db768ad,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:23.069159 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e367bf46-b67d-4d70-8076-daae6bccd603 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:23.071932 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e367bf46-b67d-4d70-8076-daae6bccd603 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:23.073453 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e367bf46-b67d-4d70-8076-daae6bccd603 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/57db3338-038e-4a92-890f-20a03db768ad HTTP/1.1" status: 204  len: 168 time: 0.2927606
Jun 01 11:10:23.105336 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-62d10953-546b-4840-bb9f-0c555036e715 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:23.136661 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-62d10953-546b-4840-bb9f-0c555036e715 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:23.210226 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-62d10953-546b-4840-bb9f-0c555036e715 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:23.225517 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-65f131d6-0059-4b78-b2f6-4b9fa1ef508c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:23.310932 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62d10953-546b-4840-bb9f-0c555036e715 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07492579-66bb-4c11-b558-c7d29c231e39,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:23.313143 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-62d10953-546b-4840-bb9f-0c555036e715 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:23.314132 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-62d10953-546b-4840-bb9f-0c555036e715 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:23.315233 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-62d10953-546b-4840-bb9f-0c555036e715 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/07492579-66bb-4c11-b558-c7d29c231e39 HTTP/1.1" status: 204  len: 168 time: 0.3229644
Jun 01 11:10:23.666822 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59806) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:23.686512 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:23.708174 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:23.712234 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Usage tracker for resource:security_group_rule and tenant:a64b7f9d62714bfaa32b17fb3081c6d3 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:23.715464 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:23.721817 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:23.819542 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:23.827283 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:23.858128 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6c40f39a-7371-40bc-9125-35582c653e07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:23.887208 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=a64b7f9d62714bfaa32b17fb3081c6d3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2190967
Jun 01 11:10:23.888718 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57102ce3-a1a2-49a0-b278-ed973a336784,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:23.889910 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59824) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:23.892058 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:24.026672 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-72ad4672-fa96-48af-9a8b-f3d2f69cbaea admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:24.061513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-72ad4672-fa96-48af-9a8b-f3d2f69cbaea admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:24.088019 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c76931b-76cc-4c28-a405-2a4734907d0c req-d57c3d6e-ded2-40c5-87e1-473790a925b7 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:24.089495 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4c76931b-76cc-4c28-a405-2a4734907d0c req-d57c3d6e-ded2-40c5-87e1-473790a925b7 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1576035
Jun 01 11:10:24.176813 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-72ad4672-fa96-48af-9a8b-f3d2f69cbaea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:24.188664 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d4441344-c577-4973-aa2c-221deb71466a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:24.197889 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4c76931b-76cc-4c28-a405-2a4734907d0c req-e5063ec6-1a61-4a4c-a035-a35b090a593e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0805097
Jun 01 11:10:24.205844 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72ad4672-fa96-48af-9a8b-f3d2f69cbaea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57102ce3-a1a2-49a0-b278-ed973a336784,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:24.209952 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-72ad4672-fa96-48af-9a8b-f3d2f69cbaea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:24.217198 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-72ad4672-fa96-48af-9a8b-f3d2f69cbaea admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:24.221141 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-72ad4672-fa96-48af-9a8b-f3d2f69cbaea admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/57102ce3-a1a2-49a0-b278-ed973a336784 HTTP/1.1" status: 204  len: 168 time: 0.3300672
Jun 01 11:10:25.243658 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-bf02b568-b9e5-4b1a-8d36-2986f2b5ea94 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:25.301708 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:25.352403 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59898) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:25.475375 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:25.493517 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:25.497391 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Usage tracker for resource:security_group_rule and tenant:85327a7996a84f9ab1a90a001e995a43 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:25.500980 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:25.507068 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:25.656784 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:25.660681 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:25.669265 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:25.711283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=85327a7996a84f9ab1a90a001e995a43&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3551526
Jun 01 11:10:25.711283 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26317e14-a563-415e-a575-898c3d7dc03c,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:25.711775 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59916) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:25.713285 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:25.776101 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fcfb3c9e-8b6d-4492-9beb-be86176cf8cc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:25.803343 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fcfb3c9e-8b6d-4492-9beb-be86176cf8cc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:25.866774 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fcfb3c9e-8b6d-4492-9beb-be86176cf8cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:25.870707 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a35090d4-e28d-4704-a8a8-645f850c7419 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:25.884658 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcfb3c9e-8b6d-4492-9beb-be86176cf8cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26317e14-a563-415e-a575-898c3d7dc03c,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:25.887107 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fcfb3c9e-8b6d-4492-9beb-be86176cf8cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:25.896930 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fcfb3c9e-8b6d-4492-9beb-be86176cf8cc admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:25.897912 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-fcfb3c9e-8b6d-4492-9beb-be86176cf8cc admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/26317e14-a563-415e-a575-898c3d7dc03c HTTP/1.1" status: 204  len: 168 time: 0.1848762
Jun 01 11:10:26.193496 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 59940) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:26.211272 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:26.225263 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:26.229027 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Usage tracker for resource:security_group_rule and tenant:c24b74e963a746f4b592c72fa07a2fe1 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:26.232363 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:26.237947 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:26.321714 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:26.326612 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:26.335156 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-65ec5306-0c27-4384-8c6d-37b096ac29fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:26.370405 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:26.374875 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=c24b74e963a746f4b592c72fa07a2fe1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1803477
Jun 01 11:10:26.376422 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3495c13-901e-47e8-a8e0-71a5657d0707,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:26.377667 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 59948) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:26.379307 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:26.446043 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6aa596e1-51a5-4e9e-8cbf-b3f9b89e57eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:26.472862 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6aa596e1-51a5-4e9e-8cbf-b3f9b89e57eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:26.527156 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6aa596e1-51a5-4e9e-8cbf-b3f9b89e57eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:26.531543 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7c29c50f-ee5e-4409-aa06-57d56d77ded3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:26.547807 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aa596e1-51a5-4e9e-8cbf-b3f9b89e57eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3495c13-901e-47e8-a8e0-71a5657d0707,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:26.550155 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6aa596e1-51a5-4e9e-8cbf-b3f9b89e57eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:26.566646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6aa596e1-51a5-4e9e-8cbf-b3f9b89e57eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:26.568014 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-6aa596e1-51a5-4e9e-8cbf-b3f9b89e57eb admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/e3495c13-901e-47e8-a8e0-71a5657d0707 HTTP/1.1" status: 204  len: 168 time: 0.1880362
Jun 01 11:10:27.097488 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-114393f1-96bb-4f41-b0ed-513d7b97b6fe req-cebab078-10ca-42a1-860c-f68f06e2ff44 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:27.098999 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-114393f1-96bb-4f41-b0ed-513d7b97b6fe req-cebab078-10ca-42a1-860c-f68f06e2ff44 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0873549
Jun 01 11:10:27.181678 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-114393f1-96bb-4f41-b0ed-513d7b97b6fe req-db1f5192-81b3-4870-aa7a-1601e6ee9118 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0721216
Jun 01 11:10:27.232366 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf497db1-666a-4ca0-9062-1a710638b658 req-b36a6ac0-86ee-4cdd-8878-c3d482612814 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:27.233937 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-bf497db1-666a-4ca0-9062-1a710638b658 req-b36a6ac0-86ee-4cdd-8878-c3d482612814 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 1098 time: 0.1106181
Jun 01 11:10:27.281708 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-bf497db1-666a-4ca0-9062-1a710638b658 req-cb4964d4-eae5-4699-9da8-1978fa0bc106 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396545
Jun 01 11:10:27.723223 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:28.385182 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa015936-b8b5-4267-908c-57d1dba6491b req-7f92d5b4-c817-43cd-b508-42855e06b52f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:28.386668 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-aa015936-b8b5-4267-908c-57d1dba6491b req-7f92d5b4-c817-43cd-b508-42855e06b52f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0867031
Jun 01 11:10:28.433291 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-aa015936-b8b5-4267-908c-57d1dba6491b req-1ed75748-2da5-44f0-a5a2-df15cd805c55 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405636
Jun 01 11:10:29.619302 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b556f064-19ba-4144-b182-d64849cdc40f req-63ed40b6-8726-4d37-a065-b52ae32bb757 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:29.620782 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b556f064-19ba-4144-b182-d64849cdc40f req-63ed40b6-8726-4d37-a065-b52ae32bb757 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.0812969
Jun 01 11:10:29.670614 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b556f064-19ba-4144-b182-d64849cdc40f req-36ffb9d4-01c5-450a-a9d6-c2b2902c3f4f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435598
Jun 01 11:10:29.862910 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48f7e0be-738b-407a-a800-51fe3e2e703c req-f6f593b7-baf5-40c8-bf61-d491aa5b375a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:29.864369 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-48f7e0be-738b-407a-a800-51fe3e2e703c req-f6f593b7-baf5-40c8-bf61-d491aa5b375a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0863991
Jun 01 11:10:29.907182 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-48f7e0be-738b-407a-a800-51fe3e2e703c req-62320e23-d350-48fb-b132-dc4c72383a34 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0371859
Jun 01 11:10:32.115037 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-60af7fdf-77f1-42f6-bbed-a869dcfa6f48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:32.117230 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-60af7fdf-77f1-42f6-bbed-a869dcfa6f48 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1099 time: 0.0765219
Jun 01 11:10:32.187750 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cdcd658-2b87-4da2-91b4-ca97987fe49f req-ac8b473c-0c44-447d-9db9-4298347baeee tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:32.189383 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4cdcd658-2b87-4da2-91b4-ca97987fe49f req-ac8b473c-0c44-447d-9db9-4298347baeee tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0967045
Jun 01 11:10:32.237700 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4cdcd658-2b87-4da2-91b4-ca97987fe49f req-bd2bc742-253f-47c4-9454-ac0d00ef9e28 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425301
Jun 01 11:10:32.257018 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-ee178033-5ef0-4395-a9ee-eb067e1de678 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:32.257018 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-ee178033-5ef0-4395-a9ee-eb067e1de678 service neutron] 10.222.0.79 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 919 time: 0.1323590
Jun 01 11:10:32.329135 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-fd26297a-3b62-438c-94b0-0e664c5414bc service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24 HTTP/1.1" status: 200  len: 217 time: 0.0634921
Jun 01 11:10:32.392237 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-0984441c-f0d1-4c23-ae5a-5ed5508b3ba1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:32.393660 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-0984441c-f0d1-4c23-ae5a-5ed5508b3ba1 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 200  len: 858 time: 0.0578959
Jun 01 11:10:32.453823 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-19daaf88-b62d-44fd-8f8f-f780388c1c12 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=e8c7dea7-722b-446b-9e9f-d27643e48187&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0451682
Jun 01 11:10:32.605835 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-243eb8f2-9cd2-4da6-b646-46642f971889 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1446824
Jun 01 11:10:32.784104 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-29337edc-e0b0-459d-b624-ac2d1aa986c0 req-04987e26-58b2-4999-89fb-397e2f5d56d5 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1550713
Jun 01 11:10:33.024859 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60216) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:33.161715 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.176770 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:33.180890 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Usage tracker for resource:security_group_rule and tenant:6c9278bcd5ae4d53bd21814a624c4705 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:33.183908 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:33.191738 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:33.285889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60230) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:33.328125 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.338920 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.348111 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9961ec41-cdbf-4e1b-b888-2ea40d43d49b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:33.415498 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa6b7bfb-cd3b-47c3-9259-ba1dc1893863,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:33.419735 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:33.422435 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=6c9278bcd5ae4d53bd21814a624c4705&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3965917
Jun 01 11:10:33.427178 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60236) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:33.505639 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cbc8d33-db23-45e0-93b7-b3f5559dcf91 req-d3288f1d-54e2-480d-8d63-932155bc5682 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:33.506137 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6cbc8d33-db23-45e0-93b7-b3f5559dcf91 req-d3288f1d-54e2-480d-8d63-932155bc5682 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1245849
Jun 01 11:10:33.506862 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.516546 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e5bc22ce-6c26-464d-846a-264a02f47bf8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.551205 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e5bc22ce-6c26-464d-846a-264a02f47bf8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.557083 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:33.562952 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Usage tracker for resource:security_group_rule and tenant:77ca886b05244a28a4fa1d7defe93a12 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:33.565995 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:33.572647 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:33.613907 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e5bc22ce-6c26-464d-846a-264a02f47bf8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.619753 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0a0962a6-0134-4f38-801e-0cf6a43524d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:33.629880 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6cbc8d33-db23-45e0-93b7-b3f5559dcf91 req-b0154a4e-3a81-470f-b532-8d7ffa21837e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0948775
Jun 01 11:10:33.629880 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60242) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:33.641923 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5bc22ce-6c26-464d-846a-264a02f47bf8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa6b7bfb-cd3b-47c3-9259-ba1dc1893863,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:33.644861 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e5bc22ce-6c26-464d-846a-264a02f47bf8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:33.655980 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e5bc22ce-6c26-464d-846a-264a02f47bf8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.660222 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e5bc22ce-6c26-464d-846a-264a02f47bf8 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/aa6b7bfb-cd3b-47c3-9259-ba1dc1893863 HTTP/1.1" status: 204  len: 168 time: 0.2316370
Jun 01 11:10:33.761803 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.771467 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.788186 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0cbaf902-2edd-431a-9e3b-300a34bd5d50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:33.878857 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0007f26a-c9fa-4801-91d1-91a015bb19fe,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:33.884281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:33.893977 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:33.899535 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=77ca886b05244a28a4fa1d7defe93a12&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6124065
Jun 01 11:10:33.902558 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60260) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:33.919744 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:33.926817 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Usage tracker for resource:security_group_rule and tenant:7d31af14c77443759f1828e8a8c1c63d is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:33.935201 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:33.945544 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:33.994979 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-26dba08d-94f0-463f-a21f-1f0d2e22e69d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.038699 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-26dba08d-94f0-463f-a21f-1f0d2e22e69d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.123489 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.130462 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.141368 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:34.162249 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-26dba08d-94f0-463f-a21f-1f0d2e22e69d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.198539 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=7d31af14c77443759f1828e8a8c1c63d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5719843
Jun 01 11:10:34.201027 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-26dba08d-94f0-463f-a21f-1f0d2e22e69d admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.201867 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60276) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:34.202330 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-26dba08d-94f0-463f-a21f-1f0d2e22e69d admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/0007f26a-c9fa-4801-91d1-91a015bb19fe HTTP/1.1" status: 204  len: 168 time: 0.2971306
Jun 01 11:10:34.202785 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=add1c446-de63-43f0-80b8-93fe8d5b4426,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:34.205987 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:34.206379 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-ef0f550d-457f-4603-b9b3-6184dfec201e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.035s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:34.216087 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26dba08d-94f0-463f-a21f-1f0d2e22e69d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0007f26a-c9fa-4801-91d1-91a015bb19fe,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:34.218534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-26dba08d-94f0-463f-a21f-1f0d2e22e69d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:34.296111 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-476e2663-7aee-4794-960c-c6df6e5a2625 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.326441 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-476e2663-7aee-4794-960c-c6df6e5a2625 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.391771 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-476e2663-7aee-4794-960c-c6df6e5a2625 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.396588 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:34.408697 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476e2663-7aee-4794-960c-c6df6e5a2625 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=add1c446-de63-43f0-80b8-93fe8d5b4426,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:34.413694 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-476e2663-7aee-4794-960c-c6df6e5a2625 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:34.415645 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-476e2663-7aee-4794-960c-c6df6e5a2625 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.416736 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-476e2663-7aee-4794-960c-c6df6e5a2625 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/add1c446-de63-43f0-80b8-93fe8d5b4426 HTTP/1.1" status: 204  len: 168 time: 0.2130089
Jun 01 11:10:34.759945 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60306) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:34.795484 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:34.832207 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:34.842198 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Usage tracker for resource:security_group_rule and tenant:2d074bdb1fa94f66a5d8d023cf06388c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:34.850325 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:34.860857 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:34.867260 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce87f993-a3b9-489b-9e77-eb4bfd34ed6f req-d97046ac-9e21-4d11-9811-390961c1539a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:34.877941 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ce87f993-a3b9-489b-9e77-eb4bfd34ed6f req-d97046ac-9e21-4d11-9811-390961c1539a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1251032
Jun 01 11:10:34.973764 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ce87f993-a3b9-489b-9e77-eb4bfd34ed6f req-4287808f-15d5-40a1-86c5-c7ea36d43e5f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0941219
Jun 01 11:10:35.051962 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:35.059300 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:35.089191 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0c231207-a24d-4a5b-bf6a-acd11c459361 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.005s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:35.138595 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=2d074bdb1fa94f66a5d8d023cf06388c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3746095
Jun 01 11:10:35.138595 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a325a6bc-c6b8-403d-a7ee-f9aa5ba2932a,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:35.138994 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60328) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:35.141336 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:35.208825 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-43a5d146-d3c4-4ba3-ab59-63668dbfc67c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:35.242248 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-43a5d146-d3c4-4ba3-ab59-63668dbfc67c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:35.316622 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-43a5d146-d3c4-4ba3-ab59-63668dbfc67c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:35.320599 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-dc6785bf-bacb-4039-b6a1-077721d1f807 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:35.332916 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43a5d146-d3c4-4ba3-ab59-63668dbfc67c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a325a6bc-c6b8-403d-a7ee-f9aa5ba2932a,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:35.335906 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-43a5d146-d3c4-4ba3-ab59-63668dbfc67c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:35.362876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-43a5d146-d3c4-4ba3-ab59-63668dbfc67c admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:35.367456 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-43a5d146-d3c4-4ba3-ab59-63668dbfc67c admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/a325a6bc-c6b8-403d-a7ee-f9aa5ba2932a HTTP/1.1" status: 204  len: 168 time: 0.2241757
Jun 01 11:10:35.522653 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60346) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:35.842996 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-861036167-network', 'tenant_id': '7bae65d9f7e14bd9a5a972ca94d43c3d'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:10:35.848793 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:35.852850 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Usage tracker for resource:network and tenant:7bae65d9f7e14bd9a5a972ca94d43c3d is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:35.856471 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:35.862797 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:35.876797 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Made reservation on behalf of 7bae65d9f7e14bd9a5a972ca94d43c3d for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:10:35.880413 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:35.887000 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60366) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:35.900055 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:35.911226 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:35.918817 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:35.922894 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Usage tracker for resource:security_group_rule and tenant:7bae65d9f7e14bd9a5a972ca94d43c3d is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:35.925798 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:35.927291 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:35.931692 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:35.933623 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Usage tracker for resource:security_group_rule and tenant:d3c22b5fe2b8424184b363217f6c0613 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:35.936931 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:35.943721 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:36.019505 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.023531 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.028053 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-47c627bc-9096-41e0-b6e1-0d270d95eaa3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:36.029255 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.033076 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.042757 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0edf3b73-4808-4374-be34-f6ca391f7683 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:36.057095 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 681}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:10:36.068726 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:36.072058 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:36.077725 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.078840 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Added segment 50169f53-532c-4126-a49b-bd813455458e of type vlan for network 7642d4f7-83cf-45f3-b430-803385a99096
Jun 01 11:10:36.087435 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=d3c22b5fe2b8424184b363217f6c0613&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1982999
Jun 01 11:10:36.088649 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea438ecd-3333-4d26-a32e-4e27cb6a30ed,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:36.090551 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60374) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:36.092915 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:36.112023 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.146654 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.148078 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:36.148705 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.150901 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c81f229d-fe5d-4a1a-8dbe-cd4247a91824 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.154112 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-431e5cad-fd35-47f0-b637-51e80b8875a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:36.177852 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c81f229d-fe5d-4a1a-8dbe-cd4247a91824 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.228067 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c81f229d-fe5d-4a1a-8dbe-cd4247a91824 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.233383 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7022052d-9217-4777-92be-cb1ea4aa3152 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:36.245139 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c81f229d-fe5d-4a1a-8dbe-cd4247a91824 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea438ecd-3333-4d26-a32e-4e27cb6a30ed,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:36.249521 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-c81f229d-fe5d-4a1a-8dbe-cd4247a91824 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:36.256800 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.7329898
Jun 01 11:10:36.258323 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c81f229d-fe5d-4a1a-8dbe-cd4247a91824 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.260646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60378) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:36.262602 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-c81f229d-fe5d-4a1a-8dbe-cd4247a91824 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/ea438ecd-3333-4d26-a32e-4e27cb6a30ed HTTP/1.1" status: 204  len: 168 time: 0.1710210
Jun 01 11:10:36.264492 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Pushing event updated for resources: {'Network': ['ID=7642d4f7-83cf-45f3-b430-803385a99096,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:36.269136 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Request body: {'subnet': {'network_id': '7642d4f7-83cf-45f3-b430-803385a99096', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-861036167-subnet', 'tenant_id': '7bae65d9f7e14bd9a5a972ca94d43c3d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:10:36.274729 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:36.277982 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:36.280973 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Usage tracker for resource:subnet and tenant:7bae65d9f7e14bd9a5a972ca94d43c3d is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:36.284135 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:36.285090 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 7642d4f7-83cf-45f3-b430-803385a99096 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:10:36.289877 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:36.301273 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Made reservation on behalf of 7bae65d9f7e14bd9a5a972ca94d43c3d for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:10:36.303797 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10623449'] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.767494 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10882903', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10623439'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.771187 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:36.846551 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1dfa662b-3182-4cf1-aa42-e313e271a7a1,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:36.851993 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:36.852706 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Checking segment: {'id': '50169f53-532c-4126-a49b-bd813455458e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 681, 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:10:36.853086 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Network hostable DHCP agents. Network: 7642d4f7-83cf-45f3-b430-803385a99096, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:10:36.871514 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Network 7642d4f7-83cf-45f3-b430-803385a99096 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:10:36.883552 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 7642d4f7-83cf-45f3-b430-803385a99096) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:10:36.898072 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed013d74-9323-4bed-9d75-53bb3b12be59 None None] Network 7642d4f7-83cf-45f3-b430-803385a99096 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:10:36.901929 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:36.902986 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:36.944240 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.6822047
Jun 01 11:10:37.149501 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3def9b72-8f80-41bc-853a-3bc78d97b861 None None] Network 7642d4f7-83cf-45f3-b430-803385a99096 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:10:37.409093 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a20eebd-a3b9-4dbd-abdc-23496ee1764c req-e026cd2d-be42-4c5d-ab47-0e6c6d359994 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:37.410665 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2a20eebd-a3b9-4dbd-abdc-23496ee1764c req-e026cd2d-be42-4c5d-ab47-0e6c6d359994 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0903325
Jun 01 11:10:37.457708 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2a20eebd-a3b9-4dbd-abdc-23496ee1764c req-a6fcc236-3521-4e44-8e86-ac884986b0a6 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409923
Jun 01 11:10:38.661642 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780e3928-30aa-4ba9-8d7b-b11ace4a03bd req-fb6c5e31-50e5-42d9-934c-b49205744e2f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:38.663186 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-780e3928-30aa-4ba9-8d7b-b11ace4a03bd req-fb6c5e31-50e5-42d9-934c-b49205744e2f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0889900
Jun 01 11:10:38.718732 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-780e3928-30aa-4ba9-8d7b-b11ace4a03bd req-d5ed0374-1dab-4656-9dc0-dae7ec292219 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0491807
Jun 01 11:10:39.023537 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60484) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:39.136540 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-0a9dfab7-f245-4e06-bf22-4005a0168808 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:39.137221 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-0a9dfab7-f245-4e06-bf22-4005a0168808 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Synchronizing usage tracker for tenant:7bae65d9f7e14bd9a5a972ca94d43c3d on resource:network {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:10:39.141930 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-3bebf54b-2fb7-4db9-9a91-add9bb189a73 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/networks?tenant_id=b19729a90cd64079a3b4ea484c538a0d&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0456603
Jun 01 11:10:39.151767 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:39.166896 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:39.172605 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Usage tracker for resource:security_group_rule and tenant:8f73ec2b8d8942279b886b552d2af93c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:39.176140 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:39.178587 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-0a9dfab7-f245-4e06-bf22-4005a0168808 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Unset dirty status for tenant:7bae65d9f7e14bd9a5a972ca94d43c3d on resource:network {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:10:39.179787 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-0a9dfab7-f245-4e06-bf22-4005a0168808 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/networks?id=7642d4f7-83cf-45f3-b430-803385a99096 HTTP/1.1" status: 200  len: 808 time: 0.2300479
Jun 01 11:10:39.182574 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:39.251947 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-7bef4853-a7d5-4962-97a7-c93aece4b845 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/quotas/7bae65d9f7e14bd9a5a972ca94d43c3d HTTP/1.1" status: 200  len: 375 time: 0.0260849
Jun 01 11:10:39.270276 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:39.275264 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:39.321412 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-6a622684-0dff-40de-84a0-02822e0a5ae4 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=7bae65d9f7e14bd9a5a972ca94d43c3d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0631871
Jun 01 11:10:39.342480 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e5bc22ce-6c26-464d-846a-264a02f47bf8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:39.382214 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=8f73ec2b8d8942279b886b552d2af93c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3572121
Jun 01 11:10:39.382941 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e0ad798-718e-4e4e-b3cb-45637e5e536b,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:39.386171 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:39.386815 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60502) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:39.417267 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-651b3495-3b0b-481f-8411-a99e3bb4ad79 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:39.419250 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-651b3495-3b0b-481f-8411-a99e3bb4ad79 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.2708015
Jun 01 11:10:39.445116 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc68372b-fd80-47d4-8802-499848296cb6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:39.446164 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-6feb858a-5dd5-4fee-8796-50379e6f7c35 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/quotas/b19729a90cd64079a3b4ea484c538a0d HTTP/1.1" status: 200  len: 375 time: 0.0200934
Jun 01 11:10:39.470972 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc68372b-fd80-47d4-8802-499848296cb6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:39.515316 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-315a6019-cf43-4d0f-a5e1-fea75d822e9a tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=b19729a90cd64079a3b4ea484c538a0d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0549948
Jun 01 11:10:39.524139 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-f2fb8363-490c-4629-8d58-a23a2a8bed1a service neutron] 10.222.0.74 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1956201
Jun 01 11:10:39.524798 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc68372b-fd80-47d4-8802-499848296cb6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:39.529750 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e77c65e5-b7ed-47eb-8a76-03deb938dc9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:39.549817 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc68372b-fd80-47d4-8802-499848296cb6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e0ad798-718e-4e4e-b3cb-45637e5e536b,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:39.557171 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fc68372b-fd80-47d4-8802-499848296cb6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:39.570878 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc68372b-fd80-47d4-8802-499848296cb6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:39.576836 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-fc68372b-fd80-47d4-8802-499848296cb6 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/1e0ad798-718e-4e4e-b3cb-45637e5e536b HTTP/1.1" status: 204  len: 168 time: 0.1890314
Jun 01 11:10:39.684706 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-da23251d-3286-4229-b77b-77f5394ed596 service neutron] 10.222.0.74 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1543751
Jun 01 11:10:39.980619 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60532) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:40.000678 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.023051 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:40.027392 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Usage tracker for resource:security_group_rule and tenant:09744f21af3841c081056dc452f96110 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:40.031530 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:40.037760 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:40.134565 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.139106 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.147310 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fad363c5-94df-45d0-ba43-e7f0354d3479 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:40.188508 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=09744f21af3841c081056dc452f96110&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2045035
Jun 01 11:10:40.188810 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60540) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:40.191685 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b0de34a-3d81-4c67-9d1c-6e2c73ce87f1,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:40.203672 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:40.250615 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9a17fe33-6269-4655-8275-0ded703b9f6b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.276892 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9a17fe33-6269-4655-8275-0ded703b9f6b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.327743 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9a17fe33-6269-4655-8275-0ded703b9f6b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.331361 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-83288757-29b3-433a-8596-92147f507c81 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:40.344993 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a17fe33-6269-4655-8275-0ded703b9f6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b0de34a-3d81-4c67-9d1c-6e2c73ce87f1,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:40.348519 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9a17fe33-6269-4655-8275-0ded703b9f6b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:40.351878 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9a17fe33-6269-4655-8275-0ded703b9f6b admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.352952 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-9a17fe33-6269-4655-8275-0ded703b9f6b admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/5b0de34a-3d81-4c67-9d1c-6e2c73ce87f1 HTTP/1.1" status: 204  len: 168 time: 0.1631861
Jun 01 11:10:40.692989 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60550) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:40.710310 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.724647 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:40.728397 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Usage tracker for resource:security_group_rule and tenant:5b5abfb032ba4756b17530b292e3fb72 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:40.731664 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:40.737252 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:40.816201 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.819762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.826466 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1266eee7-a324-4167-baf6-2bb1dcc511d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:40.866686 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=5b5abfb032ba4756b17530b292e3fb72&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1726038
Jun 01 11:10:40.867673 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9894c42d-043a-43b5-b20b-e6ece12654d4,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:40.869389 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60554) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:40.870657 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:40.930878 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb6c6f42-4705-4f20-bd14-858654aaefd8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:40.956175 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb6c6f42-4705-4f20-bd14-858654aaefd8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:41.009300 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb6c6f42-4705-4f20-bd14-858654aaefd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:41.014138 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4305673e-a615-4f8d-82d5-4c382d4b1b67 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:41.024449 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb6c6f42-4705-4f20-bd14-858654aaefd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9894c42d-043a-43b5-b20b-e6ece12654d4,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:41.026798 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fb6c6f42-4705-4f20-bd14-858654aaefd8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:41.036540 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fb6c6f42-4705-4f20-bd14-858654aaefd8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:41.037773 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-fb6c6f42-4705-4f20-bd14-858654aaefd8 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/9894c42d-043a-43b5-b20b-e6ece12654d4 HTTP/1.1" status: 204  len: 168 time: 0.1668141
Jun 01 11:10:41.802284 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:10:41.837535 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9c9b1e98-858f-4222-88df-39931cbe93e9 req-217831e3-7e6e-41fe-b070-5a1f17780c64 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 210 time: 0.1199801
Jun 01 11:10:41.902240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce219588-fd1f-41b9-a399-ed7ac5fe25e8 req-c9eeed08-5a20-4ea7-b50c-8fee4123d8d8 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:41.904091 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ce219588-fd1f-41b9-a399-ed7ac5fe25e8 req-c9eeed08-5a20-4ea7-b50c-8fee4123d8d8 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1174431
Jun 01 11:10:41.950537 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ce219588-fd1f-41b9-a399-ed7ac5fe25e8 req-1eb499dc-a4a3-4e2f-8a8b-44ba95060702 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394113
Jun 01 11:10:41.995922 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28b47a8e-775d-4f17-a64c-890a61e85baf req-f6a610b7-4b59-4635-8623-f7d3778ff1c8 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 210 time: 0.0417597
Jun 01 11:10:42.369204 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-9b9868c9-3a0f-48b1-8b2c-ab956a069991 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.79 "GET /v2.0/networks?tenant_id=b19729a90cd64079a3b4ea484c538a0d&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0345221
Jun 01 11:10:42.538529 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-46250e48-7441-4e12-bf40-0a9eeceb4b99 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:42.540136 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-46250e48-7441-4e12-bf40-0a9eeceb4b99 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.79 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1639524
Jun 01 11:10:42.560741 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Request body: {'port': {'device_id': 'bbd8f911-41bd-45b5-b49a-6e56c1a38e4c', 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76', 'admin_state_up': True, 'tenant_id': 'b19729a90cd64079a3b4ea484c538a0d'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:10:42.772771 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:42.776878 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Usage tracker for resource:port and tenant:b19729a90cd64079a3b4ea484c538a0d is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:42.780644 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Quota usage for port was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:42.791201 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:42.807520 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Made reservation on behalf of b19729a90cd64079a3b4ea484c538a0d for: {'port': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:10:42.812366 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:42.831675 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:42.848712 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:42.853568 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Usage tracker for resource:security_group_rule and tenant:b19729a90cd64079a3b4ea484c538a0d is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:42.857045 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:42.863122 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:43.069860 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-db1d023a-205d-4fc7-aa99-ce431231c350 req-4f9b80ac-c686-4755-8640-4b09c5413b43 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 210 time: 0.1119394
Jun 01 11:10:43.246005 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:43.255079 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-3140f4d4-cf3c-4435-a63f-662d10a75c4a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:43.257165 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-3140f4d4-cf3c-4435-a63f-662d10a75c4a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.79 "GET /v2.0/networks?id=7642d4f7-83cf-45f3-b430-803385a99096 HTTP/1.1" status: 200  len: 808 time: 0.3422108
Jun 01 11:10:43.257447 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edcabf66-70c1-42d1-8b15-859978d2b998 req-0316a6f2-da9a-48d2-b30d-6ff108672ffb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:43.258736 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:43.266217 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-edcabf66-70c1-42d1-8b15-859978d2b998 req-0316a6f2-da9a-48d2-b30d-6ff108672ffb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1090386
Jun 01 11:10:43.323880 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-378b47d6-2c6d-4609-ad6d-a758a5db060a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:43.358129 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Request body: {'port': {'device_id': 'bd97cd93-6681-4758-9f89-2b21b54a16a5', 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096', 'admin_state_up': True, 'tenant_id': '7bae65d9f7e14bd9a5a972ca94d43c3d'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:10:43.445215 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-edcabf66-70c1-42d1-8b15-859978d2b998 req-67a7908d-8f5a-47dd-a15a-ee34e056a60b tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1757832
Jun 01 11:10:43.448287 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d819feaa-2ed9-4eb4-971f-05504cc15919 req-5d819249-b753-46b2-8e31-ffbe50451983 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 210 time: 0.1594391
Jun 01 11:10:43.474380 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3f2c013b-8aed-4648-84e8-5a1b5e7518df,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:43.477457 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:43.616681 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:43.622559 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Usage tracker for resource:port and tenant:7bae65d9f7e14bd9a5a972ca94d43c3d is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:43.627149 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Quota usage for port was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:43.637082 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:43.647736 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Allocated IP 192.168.233.3 (fe2a4813-8fc4-470e-85ad-ebf66feddd76/d6988831-43d9-492a-8338-66d5f373b3b8/f6597bbf-8472-42e0-930e-7514f3d0f2d3) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:10:43.659326 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Made reservation on behalf of 7bae65d9f7e14bd9a5a972ca94d43c3d for: {'port': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:10:43.662813 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:43.978667 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Allocated IP 172.20.0.5 (7642d4f7-83cf-45f3-b430-803385a99096/1dfa662b-3182-4cf1-aa42-e313e271a7a1/5f6cd835-27b7-4eba-b1e4-30dd6f888de7) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:10:43.999740 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:44.030552 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Transition to ACTIVE for port object f6597bbf-8472-42e0-930e-7514f3d0f2d3 will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:10:44.235400 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:44.246626 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:44.340709 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Network fe2a4813-8fc4-470e-85ad-ebf66feddd76 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:10:44.345812 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:10:44.348253 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:10:44.380005 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:44.401132 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Pushing event updated for resources: {'Port': ['ID=f6597bbf-8472-42e0-930e-7514f3d0f2d3,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:44.412366 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:44.432963 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:44.433505 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:44.475611 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 936 time: 1.9193196
Jun 01 11:10:44.478622 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:44.484686 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:44.552332 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Network 7642d4f7-83cf-45f3-b430-803385a99096 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:10:44.555518 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:10:44.559739 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:10:44.566212 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-673e21ba-792f-42bb-a26c-6fc5eb36b127 None None] Provisioning for port f6597bbf-8472-42e0-930e-7514f3d0f2d3 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:10:44.571096 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-673e21ba-792f-42bb-a26c-6fc5eb36b127 None None] Provisioning complete for port f6597bbf-8472-42e0-930e-7514f3d0f2d3 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:10:44.571550 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-673e21ba-792f-42bb-a26c-6fc5eb36b127 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:44.591141 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Pushing event updated for resources: {'Port': ['ID=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:44.597779 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:44.628855 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:44.629468 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:44.645651 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-673e21ba-792f-42bb-a26c-6fc5eb36b127 None None] Port f6597bbf-8472-42e0-930e-7514f3d0f2d3 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:10:44.649206 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3261490
Jun 01 11:10:46.514703 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:46.532716 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Request body: {'port': {'device_id': 'bbd8f911-41bd-45b5-b49a-6e56c1a38e4c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:10:46.565366 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Request body: {'port': {'device_id': 'bd97cd93-6681-4758-9f89-2b21b54a16a5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:10:46.745261 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:46.755663 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:46.778671 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406be5fa-c592-4426-9bc4-f3e9eda221b6 req-0ed97219-9a71-43e1-b804-b31660eca3f5 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:46.780673 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-406be5fa-c592-4426-9bc4-f3e9eda221b6 req-0ed97219-9a71-43e1-b804-b31660eca3f5 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 934 time: 0.1444092
Jun 01 11:10:46.789201 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f859030-c0a9-4ccd-97c9-26f739325700 req-2811b180-79c0-4c82-94bf-2e74fa66f07f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:46.790690 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8f859030-c0a9-4ccd-97c9-26f739325700 req-2811b180-79c0-4c82-94bf-2e74fa66f07f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1176229
Jun 01 11:10:46.866548 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-406be5fa-c592-4426-9bc4-f3e9eda221b6 req-db2dba33-e4e7-4ddd-9464-b689786d40db tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0748863
Jun 01 11:10:46.874780 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8f859030-c0a9-4ccd-97c9-26f739325700 req-d17808d4-8a44-45e1-afa6-413753003278 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0637813
Jun 01 11:10:47.062428 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f35e873-712e-424b-8a7e-afe820db783c req-b1cc0484-0c1d-4c0b-a819-fe29db2841b2 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:47.063953 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7f35e873-712e-424b-8a7e-afe820db783c req-b1cc0484-0c1d-4c0b-a819-fe29db2841b2 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 931 time: 0.0856109
Jun 01 11:10:47.108854 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-7f35e873-712e-424b-8a7e-afe820db783c req-d67e14f5-2b1e-4b6a-a14b-a81fba29927b tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Synchronizing usage tracker for tenant:7bae65d9f7e14bd9a5a972ca94d43c3d on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:10:47.127026 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-7f35e873-712e-424b-8a7e-afe820db783c req-d67e14f5-2b1e-4b6a-a14b-a81fba29927b tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Unset dirty status for tenant:7bae65d9f7e14bd9a5a972ca94d43c3d on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:10:47.128289 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7f35e873-712e-424b-8a7e-afe820db783c req-d67e14f5-2b1e-4b6a-a14b-a81fba29927b tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0584314
Jun 01 11:10:47.377320 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a13178b-4ffe-4e67-913a-2b551b9f1f8c req-d0883542-9271-493f-a86c-ce44f36e67c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:47.378713 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3a13178b-4ffe-4e67-913a-2b551b9f1f8c req-d0883542-9271-493f-a86c-ce44f36e67c3 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1099 time: 0.0685098
Jun 01 11:10:47.425132 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f6597bbf-8472-42e0-930e-7514f3d0f2d3 {{(pid=119240) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:10:47.430403 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 {{(pid=119240) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:10:47.431744 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-3a13178b-4ffe-4e67-913a-2b551b9f1f8c req-91acf1df-5ba4-48db-8800-3a46e6ea0a0f service neutron] Synchronizing usage tracker for tenant:c697773770604362975b8a6dfcc33c97 on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:10:47.439246 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:47.442386 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:47.449699 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-3a13178b-4ffe-4e67-913a-2b551b9f1f8c req-91acf1df-5ba4-48db-8800-3a46e6ea0a0f service neutron] Unset dirty status for tenant:c697773770604362975b8a6dfcc33c97 on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:10:47.451425 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3a13178b-4ffe-4e67-913a-2b551b9f1f8c req-91acf1df-5ba4-48db-8800-3a46e6ea0a0f service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0558650
Jun 01 11:10:47.465208 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Transition to ACTIVE for port object f6597bbf-8472-42e0-930e-7514f3d0f2d3 will not be triggered until provisioned by entity L2. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:10:47.466222 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Transition to ACTIVE for port object 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 will not be triggered until provisioned by entity L2. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:10:47.469197 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:47.474177 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:47.514736 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:47.798511 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Pushing event updated for resources: {'Port': ['ID=f6597bbf-8472-42e0-930e-7514f3d0f2d3,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:47.865500 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.865794 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.866137 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.866482 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.866857 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.867159 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.867494 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.867904 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.868250 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.868628 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.868959 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.869288 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:47.872866 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.399s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:47.883446 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.356s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:48.021722 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Pushing event updated for resources: {'Port': ['ID=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:48.024668 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:48.029552 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Attempting to bind port f6597bbf-8472-42e0-930e-7514f3d0f2d3 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:10:48.029794 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Attempting to bind port f6597bbf-8472-42e0-930e-7514f3d0f2d3 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'bc859a66-f062-4775-9123-b19b13bb57b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 656, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:10:48.030119 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Attempting to bind port f6597bbf-8472-42e0-930e-7514f3d0f2d3 on network fe2a4813-8fc4-470e-85ad-ebf66feddd76 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:10:48.042943 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Port f6597bbf-8472-42e0-930e-7514f3d0f2d3 on network fe2a4813-8fc4-470e-85ad-ebf66feddd76 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:10:48.043311 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Attempting to bind port f6597bbf-8472-42e0-930e-7514f3d0f2d3 on network fe2a4813-8fc4-470e-85ad-ebf66feddd76 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:10:48.055178 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Attempting to bind port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:10:48.055515 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Attempting to bind port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '50169f53-532c-4126-a49b-bd813455458e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 681, 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096'}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:10:48.055891 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Attempting to bind port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 on network 7642d4f7-83cf-45f3-b430-803385a99096 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:10:48.058187 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 10, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:10:48.058502 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Checking segment: {'id': 'bc859a66-f062-4775-9123-b19b13bb57b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 656, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:10:48.058905 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Bound using segment: {'id': 'bc859a66-f062-4775-9123-b19b13bb57b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 656, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:10:48.059346 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Bound port: f6597bbf-8472-42e0-930e-7514f3d0f2d3, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bc859a66-f062-4775-9123-b19b13bb57b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 656, 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76'}}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:10:48.059710 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:48.078273 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 on network 7642d4f7-83cf-45f3-b430-803385a99096 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:10:48.078585 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Attempting to bind port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 on network 7642d4f7-83cf-45f3-b430-803385a99096 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:10:48.187252 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca732a73-ab4a-485f-8c8d-50ad5fdc4436 req-59f7341d-b4d0-495c-ba02-df6e6f907e59 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:48.188975 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ca732a73-ab4a-485f-8c8d-50ad5fdc4436 req-59f7341d-b4d0-495c-ba02-df6e6f907e59 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1229050
Jun 01 11:10:48.196412 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] For port f6597bbf-8472-42e0-930e-7514f3d0f2d3, host hv-cinder-78776, cleared binding levels {{(pid=119240) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:10:48.200633 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] For port f6597bbf-8472-42e0-930e-7514f3d0f2d3, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f6597bbf-8472-42e0-930e-7514f3d0f2d3,segment=NetworkSegment(bc859a66-f062-4775-9123-b19b13bb57b2),segment_id=bc859a66-f062-4775-9123-b19b13bb57b2)] {{(pid=119240) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:10:48.202495 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 10, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:10:48.202927 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Checking segment: {'id': '50169f53-532c-4126-a49b-bd813455458e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 681, 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:10:48.203393 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Bound using segment: {'id': '50169f53-532c-4126-a49b-bd813455458e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 681, 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096'} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:10:48.204007 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Bound port: 5f6cd835-27b7-4eba-b1e4-30dd6f888de7, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '50169f53-532c-4126-a49b-bd813455458e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 681, 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096'}}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:10:48.204446 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:48.205141 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97f61549-153f-478d-af1b-6ecd3f5e86b9 req-5f8b1784-f7d3-44a8-be59-397799d196a8 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:48.212754 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-97f61549-153f-478d-af1b-6ecd3f5e86b9 req-5f8b1784-f7d3-44a8-be59-397799d196a8 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 946 time: 0.1862249
Jun 01 11:10:48.277785 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:48.303913 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:48.304397 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ca732a73-ab4a-485f-8c8d-50ad5fdc4436 req-9e49d956-6df2-47d6-a3fc-e5122cb4eff7 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1077635
Jun 01 11:10:48.318171 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-97f61549-153f-478d-af1b-6ecd3f5e86b9 req-5180b48a-0bf5-4f91-8189-2032e3b49a7f tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1040986
Jun 01 11:10:48.407898 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Pushing event updated for resources: {'Port': ['ID=f6597bbf-8472-42e0-930e-7514f3d0f2d3,revision_number=3']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:48.416139 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:48.424711 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:48.425390 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:48.426879 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] 10.222.0.79 "PUT /v2.0/ports/f6597bbf-8472-42e0-930e-7514f3d0f2d3 HTTP/1.1" status: 200  len: 1096 time: 1.9007781
Jun 01 11:10:48.427647 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bbd8f911-41bd-45b5-b49a-6e56c1a38e4c', 'tag': 'f6597bbf-8472-42e0-930e-7514f3d0f2d3'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:10:48.430681 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15317fbf-2aac-4700-95d8-0cf8c7748073" -d '{"events": [{"name": "network-changed", "server_uuid": "bbd8f911-41bd-45b5-b49a-6e56c1a38e4c", "tag": "f6597bbf-8472-42e0-930e-7514f3d0f2d3"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:10:48.548858 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e7470f8-b5ad-47eb-b785-286bff5ed4ca req-ddfd2071-3e0e-407b-b69b-064fc270752a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:48.555993 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5e7470f8-b5ad-47eb-b785-286bff5ed4ca req-ddfd2071-3e0e-407b-b69b-064fc270752a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 943 time: 0.1439798
Jun 01 11:10:48.563387 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:10:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b87574e9-22b4-432d-baab-46ab25602ca0 x-openstack-request-id: req-b87574e9-22b4-432d-baab-46ab25602ca0 {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:10:48.563387 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bbd8f911-41bd-45b5-b49a-6e56c1a38e4c", "tag": "f6597bbf-8472-42e0-930e-7514f3d0f2d3", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:10:48.563795 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-b87574e9-22b4-432d-baab-46ab25602ca0 {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:10:48.564272 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bbd8f911-41bd-45b5-b49a-6e56c1a38e4c', 'tag': 'f6597bbf-8472-42e0-930e-7514f3d0f2d3', 'status': 'completed', 'code': 200}
Jun 01 11:10:48.566702 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] For port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7, host hv-cinder-78776, cleared binding levels {{(pid=119240) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:10:48.589729 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] For port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119240) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:10:48.597867 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:48.603861 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:48.625511 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5e7470f8-b5ad-47eb-b785-286bff5ed4ca req-8539c80c-4770-43c6-80fc-7ec66d16bc86 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0684767
Jun 01 11:10:48.673820 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:48.674518 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:48.675965 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] 10.222.0.79 "PUT /v2.0/ports/5f6cd835-27b7-4eba-b1e4-30dd6f888de7 HTTP/1.1" status: 200  len: 1093 time: 2.1486094
Jun 01 11:10:48.692160 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Pushing event updated for resources: {'Port': ['ID=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,revision_number=3']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:48.700296 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-b36b381d-43a5-41ad-b6cd-5a384c3732a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:48.701903 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-b36b381d-43a5-41ad-b6cd-5a384c3732a6 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=b19729a90cd64079a3b4ea484c538a0d&device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 1099 time: 0.2022040
Jun 01 11:10:48.703447 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:48.830089 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-7d150e6b-1810-489e-9f9b-b534742c5250 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.3&port_id=f6597bbf-8472-42e0-930e-7514f3d0f2d3 HTTP/1.1" status: 200  len: 217 time: 0.1099188
Jun 01 11:10:48.912468 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-c67afb72-2c60-495c-a107-b765de3a0b0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:48.913814 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-c67afb72-2c60-495c-a107-b765de3a0b0b service neutron] 10.222.0.79 "GET /v2.0/subnets?id=d6988831-43d9-492a-8338-66d5f373b3b8 HTTP/1.1" status: 200  len: 843 time: 0.0761418
Jun 01 11:10:48.967902 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-f5b5fc9d-21fe-4573-8e82-34e335c85e0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:48.969359 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-f5b5fc9d-21fe-4573-8e82-34e335c85e0e service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7bae65d9f7e14bd9a5a972ca94d43c3d&device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 1096 time: 0.1887934
Jun 01 11:10:49.047415 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-271c0fd9-9bc0-4a35-9a2b-1207c4fdd990 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5f6cd835-27b7-4eba-b1e4-30dd6f888de7 HTTP/1.1" status: 200  len: 217 time: 0.0674300
Jun 01 11:10:49.104171 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-86b80fd5-9ad3-4a40-b3eb-833ff2fa5a86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:49.105637 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-86b80fd5-9ad3-4a40-b3eb-833ff2fa5a86 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=fe2a4813-8fc4-470e-85ad-ebf66feddd76&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.1828527
Jun 01 11:10:49.135488 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-2c97ad9c-2b3d-413e-9a21-b3b9dc24f40c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:49.136912 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-2c97ad9c-2b3d-413e-9a21-b3b9dc24f40c service neutron] 10.222.0.79 "GET /v2.0/subnets?id=1dfa662b-3182-4cf1-aa42-e313e271a7a1 HTTP/1.1" status: 200  len: 848 time: 0.0834625
Jun 01 11:10:49.242168 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-21daa881-7ad8-4701-9d80-2ede4f7e9b31 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7642d4f7-83cf-45f3-b430-803385a99096&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0958638
Jun 01 11:10:49.367319 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-6feb7b7c-a9d2-4ec7-86e1-aa1d3449babf service neutron] 10.222.0.79 "GET /v2.0/networks/fe2a4813-8fc4-470e-85ad-ebf66feddd76?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2533576
Jun 01 11:10:49.500246 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-af7671e0-ffa8-4e66-8216-ada8e8517651 service neutron] 10.222.0.79 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2359807
Jun 01 11:10:49.571832 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea944980-dd19-44f7-8112-466f83d6f112 req-411c7b60-a94f-4f0f-8cd2-d6360e7cc37a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:49.573458 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ea944980-dd19-44f7-8112-466f83d6f112 req-411c7b60-a94f-4f0f-8cd2-d6360e7cc37a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1466677
Jun 01 11:10:49.585757 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363ea3ce-be33-4bb0-896d-99cf37136d20 req-9eab12cc-ece3-49f5-baa1-6f46b4039503 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:49.592919 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-363ea3ce-be33-4bb0-896d-99cf37136d20 req-9eab12cc-ece3-49f5-baa1-6f46b4039503 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 946 time: 0.1328168
Jun 01 11:10:49.629033 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60750) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:49.683155 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-363ea3ce-be33-4bb0-896d-99cf37136d20 req-f3742ec3-d43d-4d28-a112-47ab8941ecd8 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0892749
Jun 01 11:10:49.686892 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ea944980-dd19-44f7-8112-466f83d6f112 req-aa6fc30f-a752-4c77-842e-98757db82f2e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0919721
Jun 01 11:10:49.739499 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e1e17846-818c-4299-8049-d7b658fd8d68 req-5ddc0009-c05f-4a85-9be8-100090913e45 service neutron] 10.222.0.79 "GET /v2.0/networks/fe2a4813-8fc4-470e-85ad-ebf66feddd76?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3622646
Jun 01 11:10:49.796365 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:49.862073 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:49.866177 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Usage tracker for resource:security_group_rule and tenant:eba3fb5880fe42ccae39cc710183bf84 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:49.869263 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:49.875543 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:49.950596 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f1e0be06-391f-428c-835e-389f8ac2b460 req-49770546-23d8-4655-b44f-ba8c954735de service neutron] 10.222.0.79 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4433475
Jun 01 11:10:49.957826 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-11a81492-a698-4b7c-8bde-ba785a25fa65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:49.959622 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-11a81492-a698-4b7c-8bde-ba785a25fa65 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=b19729a90cd64079a3b4ea484c538a0d&device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 1099 time: 0.1306119
Jun 01 11:10:49.966782 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:49.985541 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:49.996087 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-43a5d146-d3c4-4ba3-ab59-63668dbfc67c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:50.063287 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60770) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:50.082333 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=eba3fb5880fe42ccae39cc710183bf84&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4520628
Jun 01 11:10:50.084288 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65eb57b6-a6ca-4ef8-a798-e067e0ac08ce,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:50.088675 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60778) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:50.107373 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.108125 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.108876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.109449 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.110033 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.110600 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.111191 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.111770 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.112340 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.112909 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.113465 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.114094 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:50.143367 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:50.173767 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21552cf6-70ae-4a19-bba0-cf4b27388335 req-c89f0650-07f0-448c-8c7f-c27c1a42807a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:50.181147 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-21552cf6-70ae-4a19-bba0-cf4b27388335 req-c89f0650-07f0-448c-8c7f-c27c1a42807a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 943 time: 0.3632820
Jun 01 11:10:50.205740 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-0182d49f-7866-4b89-becd-6940fbe8935a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:50.207428 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-0182d49f-7866-4b89-becd-6940fbe8935a service neutron] 10.222.0.79 "GET /v2.0/networks?id=fe2a4813-8fc4-470e-85ad-ebf66feddd76 HTTP/1.1" status: 200  len: 870 time: 0.2341075
Jun 01 11:10:50.272608 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:50.302324 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-21552cf6-70ae-4a19-bba0-cf4b27388335 req-e0f470fa-e8bc-4b1e-b1db-a7f579a15c48 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1034284
Jun 01 11:10:50.305208 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-48fa4b55-9bd0-46fc-ad1a-acd9fa40cd61 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.3&port_id=f6597bbf-8472-42e0-930e-7514f3d0f2d3 HTTP/1.1" status: 200  len: 217 time: 0.0790734
Jun 01 11:10:50.307849 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-e6fea68d-8a23-44b4-86b8-286677fe3c19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:50.310126 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-e6fea68d-8a23-44b4-86b8-286677fe3c19 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1099 time: 0.1603901
Jun 01 11:10:50.313321 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1ab69c1f-ade2-4a28-bf95-b87178eba107 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:50.342185 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:50.353433 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Usage tracker for resource:security_group_rule and tenant:c4b1ef7f5b4745c7b44436f6212d9a1c is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:50.359010 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:50.372333 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1ab69c1f-ade2-4a28-bf95-b87178eba107 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:50.379187 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:50.509762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-6ba58d1d-4471-49d7-a877-356ce940b304 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:50.511441 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-6ba58d1d-4471-49d7-a877-356ce940b304 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=d6988831-43d9-492a-8338-66d5f373b3b8 HTTP/1.1" status: 200  len: 843 time: 0.1841605
Jun 01 11:10:50.519533 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1ab69c1f-ade2-4a28-bf95-b87178eba107 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:50.528403 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c0dfbc7a-9d64-4bf3-94ed-f819bcca12ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:50.552066 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ab69c1f-ade2-4a28-bf95-b87178eba107 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65eb57b6-a6ca-4ef8-a798-e067e0ac08ce,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:50.567450 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd97cd93-6681-4758-9f89-2b21b54a16a5', 'tag': '5f6cd835-27b7-4eba-b1e4-30dd6f888de7'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:10:50.568808 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1ab69c1f-ade2-4a28-bf95-b87178eba107 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:50.569488 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b05e5d6-9ffc-4572-b60a-8182457e488b" -d '{"events": [{"name": "network-changed", "server_uuid": "bd97cd93-6681-4758-9f89-2b21b54a16a5", "tag": "5f6cd835-27b7-4eba-b1e4-30dd6f888de7"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:10:50.597358 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1ab69c1f-ade2-4a28-bf95-b87178eba107 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:50.601166 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-1ab69c1f-ade2-4a28-bf95-b87178eba107 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/65eb57b6-a6ca-4ef8-a798-e067e0ac08ce HTTP/1.1" status: 204  len: 168 time: 0.5040910
Jun 01 11:10:50.623326 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91eacb90-b345-4060-964b-4ee477e7d5ad req-123e144d-00c9-4bb7-9291-04077fecd35e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:50.630934 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-91eacb90-b345-4060-964b-4ee477e7d5ad req-123e144d-00c9-4bb7-9291-04077fecd35e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.2205746
Jun 01 11:10:50.631211 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-a3a7b266-c1ad-4dcf-973b-1a0b647d9e2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:50.632679 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-a3a7b266-c1ad-4dcf-973b-1a0b647d9e2f service neutron] 10.222.0.79 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 919 time: 0.2428925
Jun 01 11:10:50.677576 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:50.685266 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:50.693728 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:50.705560 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:10:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8166aa9e-b885-4304-b42c-5570b1419587 x-openstack-request-id: req-8166aa9e-b885-4304-b42c-5570b1419587 {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:10:50.705880 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bd97cd93-6681-4758-9f89-2b21b54a16a5", "tag": "5f6cd835-27b7-4eba-b1e4-30dd6f888de7", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:10:50.706154 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-8166aa9e-b885-4304-b42c-5570b1419587 {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:10:50.706553 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bd97cd93-6681-4758-9f89-2b21b54a16a5', 'tag': '5f6cd835-27b7-4eba-b1e4-30dd6f888de7', 'status': 'completed', 'code': 200}
Jun 01 11:10:50.708745 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-92a74480-9bad-4fd2-8b3f-769b6db7c43b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:50.710230 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-92a74480-9bad-4fd2-8b3f-769b6db7c43b service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=fe2a4813-8fc4-470e-85ad-ebf66feddd76&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.1901076
Jun 01 11:10:50.719189 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-67c78e62-1936-4b4b-a43c-7071aa3f924c service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24 HTTP/1.1" status: 200  len: 217 time: 0.0762956
Jun 01 11:10:50.797933 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-91eacb90-b345-4060-964b-4ee477e7d5ad req-a021111e-9cb0-417e-a48d-7db01937c377 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1659601
Jun 01 11:10:50.812623 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=c4b1ef7f5b4745c7b44436f6212d9a1c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7463393
Jun 01 11:10:50.813582 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74dbc783-4374-4b2c-88b2-384b9e31d7dd,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:50.816852 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60796) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:50.823879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:50.946411 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-112f8a6e-df80-4415-9df4-f2c54162f3f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:50.947947 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-112f8a6e-df80-4415-9df4-f2c54162f3f0 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 200  len: 858 time: 0.1917350
Jun 01 11:10:50.953785 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-0b657f2d-abf7-4ac5-b1e3-7f3d87ded33b service neutron] 10.222.0.79 "GET /v2.0/networks/fe2a4813-8fc4-470e-85ad-ebf66feddd76?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2196996
Jun 01 11:10:50.968747 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4bf4ce38-b888-40b9-9a59-01974027b456 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:50.984530 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-9dffe2ae-05d7-49d5-860f-850b5fcba0a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:50.986097 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-9dffe2ae-05d7-49d5-860f-850b5fcba0a5 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7bae65d9f7e14bd9a5a972ca94d43c3d&device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 1096 time: 0.2652216
Jun 01 11:10:50.998365 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51b8f809-e95b-43f0-9ea4-cae30d2644ef req-ae4eaf32-b791-4be3-89a2-33d130ae5280 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:51.004241 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-51b8f809-e95b-43f0-9ea4-cae30d2644ef req-ae4eaf32-b791-4be3-89a2-33d130ae5280 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 946 time: 0.1954432
Jun 01 11:10:51.024868 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-9c7f4e00-89a5-4efc-8bac-f4d6efb05207 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=e8c7dea7-722b-446b-9e9f-d27643e48187&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0631855
Jun 01 11:10:51.035401 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4bf4ce38-b888-40b9-9a59-01974027b456 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:51.084861 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-51b8f809-e95b-43f0-9ea4-cae30d2644ef req-5488a48d-1c61-4086-8b47-77c2f96fd11d tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0794568
Jun 01 11:10:51.116735 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4bf4ce38-b888-40b9-9a59-01974027b456 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:51.120719 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f232c855-0dda-4b7a-869a-743a8cd858fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:51.135844 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf4ce38-b888-40b9-9a59-01974027b456 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74dbc783-4374-4b2c-88b2-384b9e31d7dd,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:51.140614 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-15317fbf-2aac-4700-95d8-0cf8c7748073 req-3a9aa249-5041-4024-8930-9fd7da00f8d2 service neutron] 10.222.0.79 "GET /v2.0/networks/fe2a4813-8fc4-470e-85ad-ebf66feddd76?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1412284
Jun 01 11:10:51.142343 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4bf4ce38-b888-40b9-9a59-01974027b456 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:51.143464 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-4bf4ce38-b888-40b9-9a59-01974027b456 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/74dbc783-4374-4b2c-88b2-384b9e31d7dd HTTP/1.1" status: 204  len: 168 time: 0.3227458
Jun 01 11:10:51.144498 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4bf4ce38-b888-40b9-9a59-01974027b456 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:51.579050 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2ffe4c2-92f1-4f97-b875-3963f84fd788 req-b983f78b-a59b-4484-8347-331903d3f6e6 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:51.580713 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f2ffe4c2-92f1-4f97-b875-3963f84fd788 req-b983f78b-a59b-4484-8347-331903d3f6e6 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 943 time: 0.1640108
Jun 01 11:10:51.598747 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 60830) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:51.616869 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:51.627000 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f2ffe4c2-92f1-4f97-b875-3963f84fd788 req-dec119e8-0825-4070-934b-42449cc75f31 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406597
Jun 01 11:10:51.632809 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:10:51.637289 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Usage tracker for resource:security_group_rule and tenant:f935582256fb4fb6806c9833c227d7e3 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:10:51.648429 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:10:51.654922 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:10:51.762527 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:51.766200 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:51.776133 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-c81f229d-fe5d-4a1a-8dbe-cd4247a91824 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:51.822095 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=f935582256fb4fb6806c9833c227d7e3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2221825
Jun 01 11:10:51.823580 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41c3cc72-eb91-4971-9040-625eb8b4d238,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:51.825481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 60838) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:10:51.827219 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:51.886686 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f8d940f5-2ad0-4d9f-8c44-389831bc3823 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:51.916445 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f8d940f5-2ad0-4d9f-8c44-389831bc3823 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:51.983382 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f8d940f5-2ad0-4d9f-8c44-389831bc3823 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:51.987201 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cb286e87-b654-45b6-8f48-f286f695540e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:51.998413 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8d940f5-2ad0-4d9f-8c44-389831bc3823 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41c3cc72-eb91-4971-9040-625eb8b4d238,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:52.004851 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f8d940f5-2ad0-4d9f-8c44-389831bc3823 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:52.011508 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f8d940f5-2ad0-4d9f-8c44-389831bc3823 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:52.014141 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f8d940f5-2ad0-4d9f-8c44-389831bc3823 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/41c3cc72-eb91-4971-9040-625eb8b4d238 HTTP/1.1" status: 204  len: 168 time: 0.1874759
Jun 01 11:10:52.696281 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-71cdb26b-f7d6-4365-91ac-09d6f07eeb31 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:54.171147 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-82294b46-0c48-4fe9-a405-b10e81281b6c service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1690948
Jun 01 11:10:54.215905 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-defb4c56-21ee-4c93-ad92-392fc40d1d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:54.217329 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-defb4c56-21ee-4c93-ad92-392fc40d1d2a service neutron] 10.222.0.79 "GET /v2.0/networks?id=7642d4f7-83cf-45f3-b430-803385a99096 HTTP/1.1" status: 200  len: 909 time: 0.2334490
Jun 01 11:10:54.307011 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-1ec98db5-c158-4bc6-aa90-6415c2b45501 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5f6cd835-27b7-4eba-b1e4-30dd6f888de7 HTTP/1.1" status: 200  len: 217 time: 0.0738492
Jun 01 11:10:54.314739 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c270e909-03fc-488b-a7dd-13f0ac85772e req-6eea920e-a5c4-4f54-b279-2ac02ea49e43 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1368341
Jun 01 11:10:54.392559 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-272b5a96-cc21-4bac-a2e3-371f4323acbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:54.394000 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-272b5a96-cc21-4bac-a2e3-371f4323acbf service neutron] 10.222.0.79 "GET /v2.0/subnets?id=1dfa662b-3182-4cf1-aa42-e313e271a7a1 HTTP/1.1" status: 200  len: 848 time: 0.0777855
Jun 01 11:10:54.410137 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4420851d-747d-4d51-bd0a-23a1062479f7 req-5d251713-e0c0-488d-adc1-6ed3c0e31a91 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:54.411506 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4420851d-747d-4d51-bd0a-23a1062479f7 req-5d251713-e0c0-488d-adc1-6ed3c0e31a91 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.2738237
Jun 01 11:10:54.449759 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c996ba-e9b2-41cb-82f9-01c5aa77506a req-48b5ea5b-f60a-4ac9-8f30-91ba8c14c7e7 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:54.451083 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41c996ba-e9b2-41cb-82f9-01c5aa77506a req-48b5ea5b-f60a-4ac9-8f30-91ba8c14c7e7 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 946 time: 0.2771559
Jun 01 11:10:54.491365 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-093739bb-5471-433b-9dbc-5918beed494d service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7642d4f7-83cf-45f3-b430-803385a99096&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0783057
Jun 01 11:10:54.511453 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device f6597bbf-8472-42e0-930e-7514f3d0f2d3 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:10:54.601086 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4420851d-747d-4d51-bd0a-23a1062479f7 req-343a780d-36d1-4fd5-a363-51418ffcb6cc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1490469
Jun 01 11:10:54.609155 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41c996ba-e9b2-41cb-82f9-01c5aa77506a req-5df01257-eb45-48ae-9148-77260afce323 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1511843
Jun 01 11:10:54.675845 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-65ccf4a4-3451-4df1-8cca-80bfb0b754ce service neutron] 10.222.0.79 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1738496
Jun 01 11:10:54.693104 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port f6597bbf-8472-42e0-930e-7514f3d0f2d3, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f6597bbf-8472-42e0-930e-7514f3d0f2d3,segment=NetworkSegment(bc859a66-f062-4775-9123-b19b13bb57b2),segment_id=bc859a66-f062-4775-9123-b19b13bb57b2)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:10:54.707293 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'f6597bbf-8472-42e0-930e-7514f3d0f2d3', 'network_id': 'fe2a4813-8fc4-470e-85ad-ebf66feddd76', 'port_id': 'f6597bbf-8472-42e0-930e-7514f3d0f2d3', 'mac_address': 'fa:16:3e:c0:ae:e2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 656, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd6988831-43d9-492a-8338-66d5f373b3b8', 'ip_address': '192.168.233.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:10:54.764329 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:54.782516 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f6597bbf-8472-42e0-930e-7514f3d0f2d3 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:10:54.797756 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port f6597bbf-8472-42e0-930e-7514f3d0f2d3, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f6597bbf-8472-42e0-930e-7514f3d0f2d3,segment=NetworkSegment(bc859a66-f062-4775-9123-b19b13bb57b2),segment_id=bc859a66-f062-4775-9123-b19b13bb57b2)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:10:54.803202 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:54.804065 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:10:54.806192 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:54.890385 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c47f367d-4c53-4226-bab1-4d0cb165563c req-2340dfb2-b9e9-4aee-924d-7a2059ed9b51 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:54.891867 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c47f367d-4c53-4226-bab1-4d0cb165563c req-2340dfb2-b9e9-4aee-924d-7a2059ed9b51 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 943 time: 0.1770556
Jun 01 11:10:54.893651 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b05e5d6-9ffc-4572-b60a-8182457e488b req-78711044-b8ad-4ec0-b6fa-df46344cd4b9 service neutron] 10.222.0.79 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1984720
Jun 01 11:10:54.942844 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c47f367d-4c53-4226-bab1-4d0cb165563c req-b4816c6d-97a2-4e00-9fc7-924ef680465d tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439520
Jun 01 11:10:54.948326 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=f6597bbf-8472-42e0-930e-7514f3d0f2d3,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:54.966996 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.967492 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.967928 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.968351 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.968750 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.969149 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.969547 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.969940 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.970348 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.970742 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.971133 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.971521 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:10:54.976670 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:55.015093 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:10:55.029015 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '5f6cd835-27b7-4eba-b1e4-30dd6f888de7', 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096', 'port_id': '5f6cd835-27b7-4eba-b1e4-30dd6f888de7', 'mac_address': 'fa:16:3e:34:86:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1dfa662b-3182-4cf1-aa42-e313e271a7a1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:10:55.087852 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:55.107259 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:10:55.123719 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:10:55.132148 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:55.134141 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:10:55.249364 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:10:55.252385 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-43848edd-fd15-4fd4-af59-adf3cd1c1745 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:55.253771 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:10:55.305899 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:55.483822 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['5f6cd835-27b7-4eba-b1e4-30dd6f888de7'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:10:55.536397 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['f6597bbf-8472-42e0-930e-7514f3d0f2d3'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:10:55.909676 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f40bf8a0-29fc-4f85-a81d-6334290cb7be req-d070f6dc-3af5-4954-8c3c-bf035c4522fc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:55.911110 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f40bf8a0-29fc-4f85-a81d-6334290cb7be req-d070f6dc-3af5-4954-8c3c-bf035c4522fc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1433680
Jun 01 11:10:55.919563 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48b76ad2-9bdf-45f9-a2d7-0cb9b495281e req-00d658c2-57c2-438e-b503-2355b5c99c47 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:55.920919 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-48b76ad2-9bdf-45f9-a2d7-0cb9b495281e req-00d658c2-57c2-438e-b503-2355b5c99c47 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 947 time: 0.1165466
Jun 01 11:10:55.991974 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f40bf8a0-29fc-4f85-a81d-6334290cb7be req-97f825c6-4fa8-4cd0-81cc-521e673f832e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0701137
Jun 01 11:10:55.994567 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-48b76ad2-9bdf-45f9-a2d7-0cb9b495281e req-44bfe8c7-3870-4707-be6a-65b29a6de9db tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0577290
Jun 01 11:10:56.163006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fa64569-25bf-4d61-b47f-7032e115b6f6 req-448ccd7a-2d70-4b77-ac7b-b4ef70b48777 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:56.164485 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3fa64569-25bf-4d61-b47f-7032e115b6f6 req-448ccd7a-2d70-4b77-ac7b-b4ef70b48777 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 944 time: 0.0793848
Jun 01 11:10:56.209922 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3fa64569-25bf-4d61-b47f-7032e115b6f6 req-5e9a02dd-4268-4e48-bcec-c1d184cdcb21 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393181
Jun 01 11:10:56.372219 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:57.720828 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:10:59.677438 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5160fa25-0c2a-45e2-8c83-c4735a737fa0 req-ee805541-1b1e-494a-89a7-04331b9a0aca tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:59.678899 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5160fa25-0c2a-45e2-8c83-c4735a737fa0 req-ee805541-1b1e-494a-89a7-04331b9a0aca tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1420763
Jun 01 11:10:59.689128 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48b34a3-5781-4215-9cd4-0534065ba84b req-a729ff5c-cb30-4af3-b534-3f71e617a0c6 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:10:59.690570 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d48b34a3-5781-4215-9cd4-0534065ba84b req-a729ff5c-cb30-4af3-b534-3f71e617a0c6 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 947 time: 0.1139286
Jun 01 11:10:59.837108 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5160fa25-0c2a-45e2-8c83-c4735a737fa0 req-04cf2b26-a033-419c-a7ac-74ff662df8aa tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1454742
Jun 01 11:10:59.841947 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d48b34a3-5781-4215-9cd4-0534065ba84b req-7f1a6411-0a05-4add-a640-37a8f061674d tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1333013
Jun 01 11:11:00.023482 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-346add9a-451a-4ab5-9481-4db8bcd213b1 req-bf707a55-c230-4aa0-9146-ab2e1a30e0af tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:00.025242 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-346add9a-451a-4ab5-9481-4db8bcd213b1 req-bf707a55-c230-4aa0-9146-ab2e1a30e0af tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 944 time: 0.0926166
Jun 01 11:11:00.074969 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-346add9a-451a-4ab5-9481-4db8bcd213b1 req-e0e8c04b-c9e5-46b7-b3df-6726133c6941 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435019
Jun 01 11:11:00.557694 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device f6597bbf-8472-42e0-930e-7514f3d0f2d3 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:00.565662 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 32812) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:00.625436 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port f6597bbf-8472-42e0-930e-7514f3d0f2d3 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:00.629802 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port f6597bbf-8472-42e0-930e-7514f3d0f2d3 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:00.630188 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:00.758441 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:00.761828 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:00.776595 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:00.780963 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Usage tracker for resource:security_group_rule and tenant:b2d544664e5748b2b5f53a8d1044d8bf is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:00.783842 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:00.787342 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bbd8f911-41bd-45b5-b49a-6e56c1a38e4c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6597bbf-8472-42e0-930e-7514f3d0f2d3'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:00.789464 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:00.789699 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-138ee8fc-7bd1-4f8e-b4d4-973dd1f2c8d2" -d '{"events": [{"server_uuid": "bbd8f911-41bd-45b5-b49a-6e56c1a38e4c", "name": "network-vif-plugged", "status": "completed", "tag": "f6597bbf-8472-42e0-930e-7514f3d0f2d3"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:00.797387 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port f6597bbf-8472-42e0-930e-7514f3d0f2d3, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f6597bbf-8472-42e0-930e-7514f3d0f2d3,segment=NetworkSegment(bc859a66-f062-4775-9123-b19b13bb57b2),segment_id=bc859a66-f062-4775-9123-b19b13bb57b2)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:00.802444 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:00.803312 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:00.831906 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:00.865025 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e85a85ed-8e09-4f1d-a86c-78137a050234 x-openstack-request-id: req-e85a85ed-8e09-4f1d-a86c-78137a050234 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:00.865382 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bbd8f911-41bd-45b5-b49a-6e56c1a38e4c", "name": "network-vif-plugged", "status": "completed", "tag": "f6597bbf-8472-42e0-930e-7514f3d0f2d3", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:00.865651 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-e85a85ed-8e09-4f1d-a86c-78137a050234 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:00.866045 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bbd8f911-41bd-45b5-b49a-6e56c1a38e4c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6597bbf-8472-42e0-930e-7514f3d0f2d3', 'code': 200}
Jun 01 11:11:00.878449 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:00.883677 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:00.892759 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e367bf46-b67d-4d70-8076-daae6bccd603 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:00.921797 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10bf451f-4b98-4c64-bc91-603c66b1f954,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:00.926253 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=f6597bbf-8472-42e0-930e-7514f3d0f2d3,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:00.926419 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:00.929335 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:00.939234 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:00.946030 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:00.946356 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=b2d544664e5748b2b5f53a8d1044d8bf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3793349
Jun 01 11:11:00.946622 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:00.946850 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 32824) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:01.065536 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.068852 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a7c95fd9-369d-4bf0-bdef-3d366cdc4303 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.097640 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:01.103191 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.105114 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b12077c-f703-4629-a229-627dc3f627ed req-ab29c87d-8749-4a5b-a0db-8ac7c9c49940 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:01.105915 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:01.106703 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b12077c-f703-4629-a229-627dc3f627ed req-ab29c87d-8749-4a5b-a0db-8ac7c9c49940 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1477444
Jun 01 11:11:01.108490 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a7c95fd9-369d-4bf0-bdef-3d366cdc4303 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.177073 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:01.181424 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:01.185045 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b12077c-f703-4629-a229-627dc3f627ed req-6916a7a3-57de-44b5-ab11-00f68a757161 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0691595
Jun 01 11:11:01.209085 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a7c95fd9-369d-4bf0-bdef-3d366cdc4303 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.216828 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f6784480-b968-4924-b13d-1e47945e12f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:01.229978 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a7c95fd9-369d-4bf0-bdef-3d366cdc4303 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.243817 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-a7c95fd9-369d-4bf0-bdef-3d366cdc4303 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/10bf451f-4b98-4c64-bc91-603c66b1f954 HTTP/1.1" status: 204  len: 168 time: 0.2885256
Jun 01 11:11:01.246405 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7c95fd9-369d-4bf0-bdef-3d366cdc4303 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10bf451f-4b98-4c64-bc91-603c66b1f954,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:01.262684 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a7c95fd9-369d-4bf0-bdef-3d366cdc4303 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:01.424639 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90581a16-0083-426a-9268-4c3f323a1436 req-5f4e2ea3-4ea0-4493-ac12-c52aaaf138eb tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:01.426156 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-90581a16-0083-426a-9268-4c3f323a1436 req-5f4e2ea3-4ea0-4493-ac12-c52aaaf138eb tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 948 time: 0.0975254
Jun 01 11:11:01.483757 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-90581a16-0083-426a-9268-4c3f323a1436 req-d9eb20c1-8ce2-45c1-8d2d-1bc52f4e3145 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0514197
Jun 01 11:11:01.601668 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 32850) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:01.635007 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.663169 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:01.667965 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Usage tracker for resource:security_group_rule and tenant:1e11d84a9436403586146c4360b4ee1e is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:01.671937 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:01.673753 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab5c31c-ed60-4079-81c0-f32c2148e6ac req-3409f07c-88f9-4a5b-9355-c9dec4f17d2f tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:01.678744 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:01.682486 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ab5c31c-ed60-4079-81c0-f32c2148e6ac req-3409f07c-88f9-4a5b-9355-c9dec4f17d2f tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 945 time: 0.1034245
Jun 01 11:11:01.728652 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ab5c31c-ed60-4079-81c0-f32c2148e6ac req-9b70ddbe-2b22-42c1-aaf8-3c0e45cd6c27 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0453854
Jun 01 11:11:01.770271 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.774419 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.782203 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-62d10953-546b-4840-bb9f-0c555036e715 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:01.822566 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=1e11d84a9436403586146c4360b4ee1e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2197793
Jun 01 11:11:01.823459 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63e5e4a7-774b-47f3-88c4-a81ef1f7b30f,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:01.825295 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 32858) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:01.826270 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:01.882916 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3792dabc-4d28-4e54-942b-0b0b9eeaa12b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.908113 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3792dabc-4d28-4e54-942b-0b0b9eeaa12b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.957508 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3792dabc-4d28-4e54-942b-0b0b9eeaa12b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.961946 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-48cb54c5-3432-4a29-8e4c-472bdbbd06ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:01.972317 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3792dabc-4d28-4e54-942b-0b0b9eeaa12b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63e5e4a7-774b-47f3-88c4-a81ef1f7b30f,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:01.975646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3792dabc-4d28-4e54-942b-0b0b9eeaa12b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:01.979395 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3792dabc-4d28-4e54-942b-0b0b9eeaa12b admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:01.980543 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-3792dabc-4d28-4e54-942b-0b0b9eeaa12b admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/63e5e4a7-774b-47f3-88c4-a81ef1f7b30f HTTP/1.1" status: 204  len: 168 time: 0.1541219
Jun 01 11:11:02.685965 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22606cf7-bfa1-4465-b15e-0dee45b12284 req-5af382e3-067e-4e3f-ba23-dc9fbd9cf18b tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:02.692584 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-22606cf7-bfa1-4465-b15e-0dee45b12284 req-5af382e3-067e-4e3f-ba23-dc9fbd9cf18b tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 948 time: 0.0994363
Jun 01 11:11:02.760227 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-22606cf7-bfa1-4465-b15e-0dee45b12284 req-346bb006-9bcb-4734-8893-fa7c4a8f5356 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599928
Jun 01 11:11:02.867649 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd97cd93-6681-4758-9f89-2b21b54a16a5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f6cd835-27b7-4eba-b1e4-30dd6f888de7'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:02.869993 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bc31c4de-6eac-43e2-911d-2f46decf53a7" -d '{"events": [{"server_uuid": "bd97cd93-6681-4758-9f89-2b21b54a16a5", "name": "network-vif-plugged", "status": "completed", "tag": "5f6cd835-27b7-4eba-b1e4-30dd6f888de7"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:02.993256 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6def66e2-6d5f-43a4-94ca-6255a2beea49 req-32309692-2813-4a95-ac02-75ef3ad2b3f5 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:02.994722 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6def66e2-6d5f-43a4-94ca-6255a2beea49 req-32309692-2813-4a95-ac02-75ef3ad2b3f5 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 945 time: 0.0810430
Jun 01 11:11:03.044440 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6def66e2-6d5f-43a4-94ca-6255a2beea49 req-ad041c03-f369-4ec5-bce4-55a5fb02cc4c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437572
Jun 01 11:11:03.096715 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab89b201-dfbc-4f64-976c-422615ffbfc8 x-openstack-request-id: req-ab89b201-dfbc-4f64-976c-422615ffbfc8 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:03.097025 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd97cd93-6681-4758-9f89-2b21b54a16a5", "name": "network-vif-plugged", "status": "completed", "tag": "5f6cd835-27b7-4eba-b1e4-30dd6f888de7", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:03.097292 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-ab89b201-dfbc-4f64-976c-422615ffbfc8 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:03.097696 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd97cd93-6681-4758-9f89-2b21b54a16a5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f6cd835-27b7-4eba-b1e4-30dd6f888de7', 'code': 200}
Jun 01 11:11:03.816633 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb4cddc-4c64-4d5d-953b-93b6f2195096 req-f5b2c129-c120-4940-9cb5-7f5659d52550 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:03.818304 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fdb4cddc-4c64-4d5d-953b-93b6f2195096 req-f5b2c129-c120-4940-9cb5-7f5659d52550 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 1101 time: 0.0783069
Jun 01 11:11:03.850417 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dc9abf-82ef-4cf2-a3e1-44ba8788d3e2 req-f814c638-4a92-43d0-8522-34eea330194b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:03.852409 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-38dc9abf-82ef-4cf2-a3e1-44ba8788d3e2 req-f814c638-4a92-43d0-8522-34eea330194b service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 1098 time: 0.0830173
Jun 01 11:11:03.873416 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fdb4cddc-4c64-4d5d-953b-93b6f2195096 req-9ad33eb5-cebe-4b95-bf4a-f72704ae5e42 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451455
Jun 01 11:11:03.913750 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-38dc9abf-82ef-4cf2-a3e1-44ba8788d3e2 req-ea6248a5-0b46-49fc-b473-725b43b08d27 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462101
Jun 01 11:11:03.960310 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b4e605-c194-49f8-8fe4-494a023b22ff req-d868aa91-16e1-416a-8f63-bfd460c7bc6e tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:03.961792 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-56b4e605-c194-49f8-8fe4-494a023b22ff req-d868aa91-16e1-416a-8f63-bfd460c7bc6e tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 948 time: 0.0836384
Jun 01 11:11:04.011143 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-56b4e605-c194-49f8-8fe4-494a023b22ff req-a2648e9d-8ab2-4f52-b105-a09b792388d2 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429962
Jun 01 11:11:04.237915 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2773660c-c548-40dd-a431-8b258d13207f req-6316d906-36dc-4889-bf0f-e760efd4c0ab tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:04.239400 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2773660c-c548-40dd-a431-8b258d13207f req-6316d906-36dc-4889-bf0f-e760efd4c0ab tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 945 time: 0.0842447
Jun 01 11:11:04.302400 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2773660c-c548-40dd-a431-8b258d13207f req-50752770-294c-4e86-8cf4-37495cbe8d27 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0568895
Jun 01 11:11:05.269007 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68d7803a-beb2-4e8e-b43a-4e69230319c0 req-12d7f57b-5ca0-4d2e-b29e-a536f5b2f3a2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:05.270544 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-68d7803a-beb2-4e8e-b43a-4e69230319c0 req-12d7f57b-5ca0-4d2e-b29e-a536f5b2f3a2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1892948
Jun 01 11:11:05.284260 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9a84b4-568c-42fe-83b5-ba70ae83d78a req-af5a605e-9d17-4eab-9d4f-52db0d75a0cc tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:05.285678 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7a9a84b4-568c-42fe-83b5-ba70ae83d78a req-af5a605e-9d17-4eab-9d4f-52db0d75a0cc tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 948 time: 0.1200442
Jun 01 11:11:05.357533 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-68d7803a-beb2-4e8e-b43a-4e69230319c0 req-dc11a050-565a-470d-9df5-8f8ff7021724 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0708232
Jun 01 11:11:05.365034 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7a9a84b4-568c-42fe-83b5-ba70ae83d78a req-df175594-bc09-482d-9590-1872b366d0c7 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0649772
Jun 01 11:11:05.465472 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 32968) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:05.565929 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068be8e1-a3fa-43f2-9018-bca2c33e6630 req-3ee12640-e752-476c-a97b-d5991241f5f7 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:05.567416 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-068be8e1-a3fa-43f2-9018-bca2c33e6630 req-3ee12640-e752-476c-a97b-d5991241f5f7 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 945 time: 0.0854023
Jun 01 11:11:05.608135 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:05.639399 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:05.647046 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-068be8e1-a3fa-43f2-9018-bca2c33e6630 req-26bff11c-6be3-4b62-b3ac-08a8ed3dc9dd tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0730977
Jun 01 11:11:05.647972 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Usage tracker for resource:security_group_rule and tenant:7f3d237b564040c788b8260795402749 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:05.650876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:05.656679 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:05.742113 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:05.746636 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:05.755776 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:05.797237 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=7f3d237b564040c788b8260795402749&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3301327
Jun 01 11:11:05.798246 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef54f20b-4030-42af-b144-152460af8b5c,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:05.799794 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 32986) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:05.801698 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:05.869233 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-724c941b-27c0-49fc-9ae9-9eb91c63707a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:05.895508 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-724c941b-27c0-49fc-9ae9-9eb91c63707a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:05.947936 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-724c941b-27c0-49fc-9ae9-9eb91c63707a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:05.952116 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fc68372b-fd80-47d4-8802-499848296cb6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:05.963988 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-724c941b-27c0-49fc-9ae9-9eb91c63707a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef54f20b-4030-42af-b144-152460af8b5c,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:05.968373 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-724c941b-27c0-49fc-9ae9-9eb91c63707a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:05.983539 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-724c941b-27c0-49fc-9ae9-9eb91c63707a admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:05.984678 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-724c941b-27c0-49fc-9ae9-9eb91c63707a admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/ef54f20b-4030-42af-b144-152460af8b5c HTTP/1.1" status: 204  len: 168 time: 0.1838379
Jun 01 11:11:05.985832 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 32994) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:06.217979 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:06.232660 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:06.236508 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Usage tracker for resource:security_group_rule and tenant:cd105192c5cc4e7588132015b5782a97 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:06.239350 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:06.245123 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:06.332831 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:06.336619 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:06.346359 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fcc416a8-3f77-4bfb-8049-d68080661f9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:06.392378 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=cd105192c5cc4e7588132015b5782a97&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4055364
Jun 01 11:11:06.394009 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e5a35f8-7509-43e8-92b8-a31a111c4762,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:06.394999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 33012) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:06.397094 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:06.459094 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f011b52b-28be-429c-ab9e-4cd0e8ad00e5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:06.486772 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f011b52b-28be-429c-ab9e-4cd0e8ad00e5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:06.545296 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f011b52b-28be-429c-ab9e-4cd0e8ad00e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:06.550108 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cd32c198-ce48-4dca-9bdd-e2bbec528763 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:06.565368 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f011b52b-28be-429c-ab9e-4cd0e8ad00e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e5a35f8-7509-43e8-92b8-a31a111c4762,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:06.568761 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f011b52b-28be-429c-ab9e-4cd0e8ad00e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:06.577560 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f011b52b-28be-429c-ab9e-4cd0e8ad00e5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:06.579640 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f011b52b-28be-429c-ab9e-4cd0e8ad00e5 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/2e5a35f8-7509-43e8-92b8-a31a111c4762 HTTP/1.1" status: 204  len: 168 time: 0.1825588
Jun 01 11:11:06.658078 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 33028) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:06.884046 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1557699626-network', 'tenant_id': '7e8afbfddd4f420185db35195f7b5d54'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:06.889068 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:06.893253 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Usage tracker for resource:network and tenant:7e8afbfddd4f420185db35195f7b5d54 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:06.896253 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:06.904196 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:06.913813 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Made reservation on behalf of 7e8afbfddd4f420185db35195f7b5d54 for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:11:06.916687 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:06.928972 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:06.943876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:06.947649 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Usage tracker for resource:security_group_rule and tenant:7e8afbfddd4f420185db35195f7b5d54 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:06.950931 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:06.956627 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:07.044726 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:07.048660 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:07.052564 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6aa596e1-51a5-4e9e-8cbf-b3f9b89e57eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:07.076462 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 685}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:11:07.088800 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b802acef-3487-4640-8b16-f6e4055e16d6,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:07.093356 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:07.094539 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:07.094839 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Added segment 04a7072a-bdf8-4e49-a012-f597df9410a5 of type vlan for network 73f1ca3d-3f00-45a8-bb61-3d265d008491
Jun 01 11:11:07.134407 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:07.174324 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:07.175876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:07.176448 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:07.181111 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:07.349335 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.6901667
Jun 01 11:11:07.352197 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 33056) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:07.354777 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Pushing event updated for resources: {'Network': ['ID=73f1ca3d-3f00-45a8-bb61-3d265d008491,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:07.359682 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Request body: {'subnet': {'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1557699626-subnet', 'tenant_id': '7e8afbfddd4f420185db35195f7b5d54', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:07.364003 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:07.365176 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:07.365884 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 73f1ca3d-3f00-45a8-bb61-3d265d008491 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:11:07.368747 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Usage tracker for resource:subnet and tenant:7e8afbfddd4f420185db35195f7b5d54 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:07.371568 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:07.377874 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:07.388672 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Made reservation on behalf of 7e8afbfddd4f420185db35195f7b5d54 for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:11:07.390849 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10623449'] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:07.777583 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10882903', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10623439'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:07.782101 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:07.853177 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3d925639-91b9-4f79-8619-2a656b4099a2,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:07.857182 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:07.863174 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Checking segment: {'id': '04a7072a-bdf8-4e49-a012-f597df9410a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 685, 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:07.863534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Network hostable DHCP agents. Network: 73f1ca3d-3f00-45a8-bb61-3d265d008491, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:11:07.881252 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Network 73f1ca3d-3f00-45a8-bb61-3d265d008491 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:11:07.891515 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 73f1ca3d-3f00-45a8-bb61-3d265d008491) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:07.900754 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6371c69c-deaf-45b9-8821-6157bfcb8c28 None None] Network 73f1ca3d-3f00-45a8-bb61-3d265d008491 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:11:07.915647 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:07.916999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:07.944262 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-db53b4b1-e120-401e-ad88-f99bb0a30af6 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.5906391
Jun 01 11:11:08.118388 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96cf07e6-13c3-4549-a891-557d2bddd31e None None] Network 73f1ca3d-3f00-45a8-bb61-3d265d008491 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:11:08.971640 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c805fb85-9b03-4364-aa60-b5a318f2ab23 req-68cfdc4d-0720-4412-b9ff-02d73d436228 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:08.973093 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c805fb85-9b03-4364-aa60-b5a318f2ab23 req-68cfdc4d-0720-4412-b9ff-02d73d436228 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 945 time: 0.1466510
Jun 01 11:11:08.982443 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d9c71f-62d7-44bf-95ce-c376cb0cf28b req-9dc0f210-bc33-4e11-972a-c1e73b2fcc73 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:08.983912 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b4d9c71f-62d7-44bf-95ce-c376cb0cf28b req-9dc0f210-bc33-4e11-972a-c1e73b2fcc73 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 948 time: 0.1596227
Jun 01 11:11:09.068810 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c805fb85-9b03-4364-aa60-b5a318f2ab23 req-c408cff2-428d-47d8-ab28-fb2a4183d44b tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0826666
Jun 01 11:11:09.074084 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b4d9c71f-62d7-44bf-95ce-c376cb0cf28b req-55f09fb8-1726-496c-8ca7-38faf13c95dc tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0735073
Jun 01 11:11:10.035220 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-165fe1e7-48ec-44f7-b4b5-f49cd71d6686 req-deb9987b-b22a-42b1-b834-26d803b69050 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:10.036884 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-165fe1e7-48ec-44f7-b4b5-f49cd71d6686 req-deb9987b-b22a-42b1-b834-26d803b69050 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 948 time: 0.0962029
Jun 01 11:11:10.187362 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-165fe1e7-48ec-44f7-b4b5-f49cd71d6686 req-49afd737-0cea-4f1e-8f22-4ece7ec8b2f3 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1445382
Jun 01 11:11:10.248130 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-710c4f4a-3b21-445b-940a-9c47d2a485e1 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:10.248810 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-710c4f4a-3b21-445b-940a-9c47d2a485e1 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Synchronizing usage tracker for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:network {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:11:10.264901 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-710c4f4a-3b21-445b-940a-9c47d2a485e1 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Unset dirty status for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:network {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:11:10.266092 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-710c4f4a-3b21-445b-940a-9c47d2a485e1 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/networks?id=73f1ca3d-3f00-45a8-bb61-3d265d008491 HTTP/1.1" status: 200  len: 814 time: 0.1945555
Jun 01 11:11:10.282508 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-358850a2-a217-4d3a-aebe-12b583e8b733 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/quotas/7e8afbfddd4f420185db35195f7b5d54 HTTP/1.1" status: 200  len: 375 time: 0.0101352
Jun 01 11:11:10.333370 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-25a67f96-5191-4884-bc43-022104f7d195 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=7e8afbfddd4f420185db35195f7b5d54&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0438662
Jun 01 11:11:10.477323 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9b058522-a9aa-4066-92ae-a2ff8d2d2442 service neutron] 10.222.0.74 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1366527
Jun 01 11:11:10.643206 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d3bd9bce-1ae5-4d5a-b2bf-25ca88de869d service neutron] 10.222.0.74 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1590800
Jun 01 11:11:10.884789 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e48c5d1f-0cd8-4b05-95f8-d30f44f9a4ac req-58863023-952e-4bed-9868-e6a901b7401d tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 210 time: 0.0665464
Jun 01 11:11:11.038853 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cdfbb5a-5214-4601-b699-428604e359ad req-21a1c38f-ab72-4e99-ac2f-e797f1a5a2da tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:11.040513 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6cdfbb5a-5214-4601-b699-428604e359ad req-21a1c38f-ab72-4e99-ac2f-e797f1a5a2da tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 945 time: 0.0910001
Jun 01 11:11:11.089760 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6cdfbb5a-5214-4601-b699-428604e359ad req-755fd7c0-6997-46ac-baf1-a4cf2457eeb6 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415573
Jun 01 11:11:11.388499 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fc268a4-f7f3-476d-85ba-135e565ba46a req-8b1917c9-b797-45a8-ba3a-f70a901fbc05 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:11.392073 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5fc268a4-f7f3-476d-85ba-135e565ba46a req-8b1917c9-b797-45a8-ba3a-f70a901fbc05 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 948 time: 0.0895455
Jun 01 11:11:11.437073 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5fc268a4-f7f3-476d-85ba-135e565ba46a req-399996c5-3ebb-4df2-b400-4ae00be032f2 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406740
Jun 01 11:11:11.703510 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-2514999f-a0d7-41b0-b6c7-08a58d791749 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0687666
Jun 01 11:11:11.801214 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-6305946e-d222-4c6d-b2d1-429261295049 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:11.802699 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-6305946e-d222-4c6d-b2d1-429261295049 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 1098 time: 0.0723708
Jun 01 11:11:11.956188 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a2e6d1e5-eb8f-4588-8d87-aad700bef4b4 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:11.956982 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-3ec51216-852a-43aa-a316-508e4a52314e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:11.957571 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a2e6d1e5-eb8f-4588-8d87-aad700bef4b4 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.79 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 948 time: 0.1563227
Jun 01 11:11:11.958391 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-3ec51216-852a-43aa-a316-508e4a52314e service neutron] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 917 time: 0.1331356
Jun 01 11:11:12.115603 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-b15d6599-3f64-4f35-b343-2ce438444c38 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=6c613458-8891-4e54-aa10-4a7743587916 HTTP/1.1" status: 200  len: 1001 time: 0.1451390
Jun 01 11:11:12.126954 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3ff88b0c-5043-4d75-9abc-6adda14b942d req-3c7193b0-84d8-45d1-a297-11e2a0f1eab7 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 210 time: 0.0933197
Jun 01 11:11:12.172545 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Deleting port f6597bbf-8472-42e0-930e-7514f3d0f2d3 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:11:12.172900 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:12.282283 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-e48ef02e-7700-49c4-9f27-9de87cf0f3e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:12.284124 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-e48ef02e-7700-49c4-9f27-9de87cf0f3e8 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.1009278
Jun 01 11:11:12.357854 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-4690f42b-fd37-45e7-96e6-d7b6fc9cf44a tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:12.359613 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-4690f42b-fd37-45e7-96e6-d7b6fc9cf44a tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.79 "GET /v2.0/networks?id=73f1ca3d-3f00-45a8-bb61-3d265d008491 HTTP/1.1" status: 200  len: 814 time: 0.2659435
Jun 01 11:11:12.376199 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Request body: {'port': {'device_id': '162fa94a-e72c-4955-b021-ee4d6defe252', 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491', 'admin_state_up': True, 'tenant_id': '7e8afbfddd4f420185db35195f7b5d54'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:12.518694 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-74ecff78-d4ff-47eb-9c4b-ee49f1215540 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:12.520249 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-74ecff78-d4ff-47eb-9c4b-ee49f1215540 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2205889
Jun 01 11:11:12.523506 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] For port f6597bbf-8472-42e0-930e-7514f3d0f2d3, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f6597bbf-8472-42e0-930e-7514f3d0f2d3,segment=NetworkSegment(bc859a66-f062-4775-9123-b19b13bb57b2),segment_id=bc859a66-f062-4775-9123-b19b13bb57b2)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:12.523904 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:12.608302 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:12.676737 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Usage tracker for resource:port and tenant:7e8afbfddd4f420185db35195f7b5d54 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:12.677060 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Calling delete_port for f6597bbf-8472-42e0-930e-7514f3d0f2d3 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:11:12.680164 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Quota usage for port was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:12.694635 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:12.727291 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Made reservation on behalf of 7e8afbfddd4f420185db35195f7b5d54 for: {'port': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:11:12.732105 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:12.762194 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08616b19-9bd0-4595-8dfa-759def0a88ed req-ee053086-cb5b-4a42-8d88-87b7603bb69f tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:12.764355 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-08616b19-9bd0-4595-8dfa-759def0a88ed req-ee053086-cb5b-4a42-8d88-87b7603bb69f tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 945 time: 0.4122450
Jun 01 11:11:12.819233 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-3288c1b9-f445-45d6-bc75-87c94042ee00 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2794895
Jun 01 11:11:12.963181 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-08616b19-9bd0-4595-8dfa-759def0a88ed req-25b75983-20d5-4ade-83a8-2c9542bcb01f tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1344707
Jun 01 11:11:13.001921 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-dd030741-54dc-4cb6-813f-4cd23dfeebf8 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:13.003445 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-dd030741-54dc-4cb6-813f-4cd23dfeebf8 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.79 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 945 time: 0.3204083
Jun 01 11:11:13.112045 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e376cc-d11a-445a-8343-87f79df4aaae req-544e132e-4e5e-4b3b-8020-d92a8bbeba37 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:13.113528 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-16e376cc-d11a-445a-8343-87f79df4aaae req-544e132e-4e5e-4b3b-8020-d92a8bbeba37 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/ports?device_id=bbd8f911-41bd-45b5-b49a-6e56c1a38e4c HTTP/1.1" status: 200  len: 948 time: 0.2861304
Jun 01 11:11:13.116468 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Allocated IP 172.20.0.4 (73f1ca3d-3f00-45a8-bb61-3d265d008491/3d925639-91b9-4f79-8619-2a656b4099a2/66c448af-86b3-414d-8e93-0176f06e6420) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:11:13.119308 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-613eaf38-5783-473d-bd6c-5370ae2b176c service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2884698
Jun 01 11:11:13.202754 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:13.217352 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['f6597bbf-8472-42e0-930e-7514f3d0f2d3'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:11:13.235512 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:13.293812 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Pushing event deleted for resources: {'Port': ['ID=f6597bbf-8472-42e0-930e-7514f3d0f2d3,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:13.296862 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:13.377249 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:13.385159 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-16e376cc-d11a-445a-8343-87f79df4aaae req-3044be99-0b9f-4f80-bfaa-a6ef11f738e8 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.74 "GET /v2.0/security-groups?id=3f2c013b-8aed-4648-84e8-5a1b5e7518df&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2581558
Jun 01 11:11:13.458149 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:13.464551 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-381af84e-2632-46bd-aad9-1b494de4da92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:13.482621 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] No DVR routers for this DVR port f6597bbf-8472-42e0-930e-7514f3d0f2d3 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:11:13.490287 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:13.493537 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bbd8f911-41bd-45b5-b49a-6e56c1a38e4c', 'name': 'network-vif-deleted', 'tag': 'f6597bbf-8472-42e0-930e-7514f3d0f2d3'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:13.496041 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1546ab1-7ab2-446d-bae3-2613d309a358" -d '{"events": [{"server_uuid": "bbd8f911-41bd-45b5-b49a-6e56c1a38e4c", "name": "network-vif-deleted", "tag": "f6597bbf-8472-42e0-930e-7514f3d0f2d3"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:13.516303 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ef91dd82-81c6-42b6-9052-e72afde80390 req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] 10.222.0.79 "DELETE /v2.0/ports/f6597bbf-8472-42e0-930e-7514f3d0f2d3 HTTP/1.1" status: 204  len: 173 time: 1.5462852
Jun 01 11:11:13.560615 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Deleting port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:11:13.561144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:13.568932 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Network 73f1ca3d-3f00-45a8-bb61-3d265d008491 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:13.580332 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:13.609687 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:11:13.641886 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Pushing event updated for resources: {'Port': ['ID=66c448af-86b3-414d-8e93-0176f06e6420,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:13.656661 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:13.672576 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb88f051-f6b6-4036-ae2f-37e2017af959 x-openstack-request-id: req-fb88f051-f6b6-4036-ae2f-37e2017af959 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:13.672576 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bbd8f911-41bd-45b5-b49a-6e56c1a38e4c", "name": "network-vif-deleted", "tag": "f6597bbf-8472-42e0-930e-7514f3d0f2d3", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:13.673089 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-fb88f051-f6b6-4036-ae2f-37e2017af959 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:13.673610 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bbd8f911-41bd-45b5-b49a-6e56c1a38e4c', 'name': 'network-vif-deleted', 'tag': 'f6597bbf-8472-42e0-930e-7514f3d0f2d3', 'status': 'completed', 'code': 200}
Jun 01 11:11:13.721105 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:13.724912 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:13.784831 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4130349
Jun 01 11:11:13.830415 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Request body: {'port': {'device_id': '162fa94a-e72c-4955-b021-ee4d6defe252', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:13.845114 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] For port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:13.847808 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:14.098152 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:14.111316 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Calling delete_port for 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:11:14.232891 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6409d62c-8594-4be5-a0d4-b4530fbd7169 req-225bc6ce-ff6a-4524-a16b-ddae925b4c51 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:14.236263 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6409d62c-8594-4be5-a0d4-b4530fbd7169 req-225bc6ce-ff6a-4524-a16b-ddae925b4c51 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 931 time: 0.6789956
Jun 01 11:11:14.292890 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-665391b4-fbc3-44ef-8720-7116494e516d req-a3180132-369e-4099-bf72-840658e19101 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:14.295075 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-665391b4-fbc3-44ef-8720-7116494e516d req-a3180132-369e-4099-bf72-840658e19101 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1811285
Jun 01 11:11:14.376919 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-6409d62c-8594-4be5-a0d4-b4530fbd7169 req-540f05ff-0b79-43d2-8e53-dfa2bf42fbe9 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Synchronizing usage tracker for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:11:14.436701 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-665391b4-fbc3-44ef-8720-7116494e516d req-25f22e3c-4c6e-4d03-9167-52d4c9a297e1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1203115
Jun 01 11:11:14.441464 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-6409d62c-8594-4be5-a0d4-b4530fbd7169 req-540f05ff-0b79-43d2-8e53-dfa2bf42fbe9 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Unset dirty status for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:11:14.450019 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6409d62c-8594-4be5-a0d4-b4530fbd7169 req-540f05ff-0b79-43d2-8e53-dfa2bf42fbe9 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1998074
Jun 01 11:11:14.469336 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:14.482296 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['5f6cd835-27b7-4eba-b1e4-30dd6f888de7'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:11:14.484494 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 66c448af-86b3-414d-8e93-0176f06e6420 {{(pid=119240) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:11:14.485165 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:14.492488 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:14.510157 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Transition to ACTIVE for port object 66c448af-86b3-414d-8e93-0176f06e6420 will not be triggered until provisioned by entity L2. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:14.518147 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:14.533357 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ceee6675-e1f4-4329-8943-64df5e28e6d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:14.550627 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Pushing event deleted for resources: {'Port': ['ID=5f6cd835-27b7-4eba-b1e4-30dd6f888de7,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:14.594108 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:14.672441 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] No DVR routers for this DVR port 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:11:14.679782 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:14.690397 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-30068358-373c-4dc0-98ca-21c65526f4e7 req-e20cfe14-59a5-43c7-a858-8ecb0e513df6 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=bd97cd93-6681-4758-9f89-2b21b54a16a5 HTTP/1.1" status: 200  len: 210 time: 0.0609264
Jun 01 11:11:14.693025 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e888bad8-b228-4ffc-86cb-9776a9a8d07b req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.79 "DELETE /v2.0/ports/5f6cd835-27b7-4eba-b1e4-30dd6f888de7 HTTP/1.1" status: 204  len: 173 time: 1.6516142
Jun 01 11:11:14.755257 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Pushing event updated for resources: {'Port': ['ID=66c448af-86b3-414d-8e93-0176f06e6420,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:14.759753 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:14.797142 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Attempting to bind port 66c448af-86b3-414d-8e93-0176f06e6420 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:11:14.797829 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Attempting to bind port 66c448af-86b3-414d-8e93-0176f06e6420 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '04a7072a-bdf8-4e49-a012-f597df9410a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 685, 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491'}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:11:14.797829 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Attempting to bind port 66c448af-86b3-414d-8e93-0176f06e6420 on network 73f1ca3d-3f00-45a8-bb61-3d265d008491 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:14.802803 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Port 66c448af-86b3-414d-8e93-0176f06e6420 on network 73f1ca3d-3f00-45a8-bb61-3d265d008491 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:11:14.803120 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Attempting to bind port 66c448af-86b3-414d-8e93-0176f06e6420 on network 73f1ca3d-3f00-45a8-bb61-3d265d008491 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:14.808352 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 10, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:11:14.808912 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Checking segment: {'id': '04a7072a-bdf8-4e49-a012-f597df9410a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 685, 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:14.809324 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Bound using segment: {'id': '04a7072a-bdf8-4e49-a012-f597df9410a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 685, 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491'} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:11:14.809788 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Bound port: 66c448af-86b3-414d-8e93-0176f06e6420, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '04a7072a-bdf8-4e49-a012-f597df9410a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 685, 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491'}}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:11:14.810132 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:14.912636 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] For port 66c448af-86b3-414d-8e93-0176f06e6420, host hv-cinder-78776, cleared binding levels {{(pid=119240) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:11:14.916686 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] For port 66c448af-86b3-414d-8e93-0176f06e6420, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=66c448af-86b3-414d-8e93-0176f06e6420,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119240) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:11:14.922328 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:14.927180 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-97db30c2-da85-490f-9955-f44ac3b55814 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:14.988166 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:14.988778 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:14.990143 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] 10.222.0.79 "PUT /v2.0/ports/66c448af-86b3-414d-8e93-0176f06e6420 HTTP/1.1" status: 200  len: 1093 time: 1.1867180
Jun 01 11:11:14.990623 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '162fa94a-e72c-4955-b021-ee4d6defe252', 'tag': '66c448af-86b3-414d-8e93-0176f06e6420'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:14.992891 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-550e4228-de3a-4e1e-8961-fb2c0f4c319f" -d '{"events": [{"name": "network-changed", "server_uuid": "162fa94a-e72c-4955-b021-ee4d6defe252", "tag": "66c448af-86b3-414d-8e93-0176f06e6420"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:15.012764 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Pushing event updated for resources: {'Port': ['ID=66c448af-86b3-414d-8e93-0176f06e6420,revision_number=3']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:15.019046 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:15.082948 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bd0099e-d7cf-48a2-812d-a71394c83df4 x-openstack-request-id: req-4bd0099e-d7cf-48a2-812d-a71394c83df4 {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:15.083253 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "162fa94a-e72c-4955-b021-ee4d6defe252", "tag": "66c448af-86b3-414d-8e93-0176f06e6420", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:15.083621 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-4bd0099e-d7cf-48a2-812d-a71394c83df4 {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:15.083963 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '162fa94a-e72c-4955-b021-ee4d6defe252', 'tag': '66c448af-86b3-414d-8e93-0176f06e6420', 'status': 'completed', 'code': 200}
Jun 01 11:11:15.131378 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-2f4e0df0-6a7c-4dc3-8300-48e76be319ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:15.132886 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-2f4e0df0-6a7c-4dc3-8300-48e76be319ad service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7e8afbfddd4f420185db35195f7b5d54&device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 1096 time: 0.0882792
Jun 01 11:11:15.221189 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-87926d34-4093-4bbc-97de-960e5adc4d58 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=66c448af-86b3-414d-8e93-0176f06e6420 HTTP/1.1" status: 200  len: 217 time: 0.0789061
Jun 01 11:11:15.316266 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-7ad8d3fd-14a6-4b5a-a78e-0ad5829d2d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:15.317799 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-7ad8d3fd-14a6-4b5a-a78e-0ad5829d2d83 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=3d925639-91b9-4f79-8619-2a656b4099a2 HTTP/1.1" status: 200  len: 854 time: 0.0727904
Jun 01 11:11:15.408600 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-f840f68e-2801-4e9a-81aa-a09ccc770b6d service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=73f1ca3d-3f00-45a8-bb61-3d265d008491&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0829253
Jun 01 11:11:15.721335 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd97cd93-6681-4758-9f89-2b21b54a16a5', 'name': 'network-vif-deleted', 'tag': '5f6cd835-27b7-4eba-b1e4-30dd6f888de7'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:15.724280 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eacd7bc1-d415-4b54-9172-29a75a95e627" -d '{"events": [{"server_uuid": "bd97cd93-6681-4758-9f89-2b21b54a16a5", "name": "network-vif-deleted", "tag": "5f6cd835-27b7-4eba-b1e4-30dd6f888de7"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:15.863351 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-85b8c649-6d03-4385-8b09-28c6e78e9861 service neutron] 10.222.0.79 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4454906
Jun 01 11:11:15.866408 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbd9a6d-6334-4036-b455-93896f429870 req-589f97b1-ae14-473d-9180-160fe2483787 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:15.873225 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-adbd9a6d-6334-4036-b455-93896f429870 req-589f97b1-ae14-473d-9180-160fe2483787 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 943 time: 0.2193866
Jun 01 11:11:15.883222 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60aed19f-5a6a-44fc-8c66-6d543c48bc1d req-60069c3b-a5c4-47c8-9a47-be1e1f460502 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:15.892275 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-60aed19f-5a6a-44fc-8c66-6d543c48bc1d req-60069c3b-a5c4-47c8-9a47-be1e1f460502 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1520751
Jun 01 11:11:15.976982 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-adbd9a6d-6334-4036-b455-93896f429870 req-c873597d-7d28-4ce5-90f6-31c5d9a58d26 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1028457
Jun 01 11:11:15.997322 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-60aed19f-5a6a-44fc-8c66-6d543c48bc1d req-209dd9cb-4eb4-4d4b-b734-337d30be48c1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1029377
Jun 01 11:11:16.065078 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-654405ce-cd23-47c7-be8c-e6abdb764f9b x-openstack-request-id: req-654405ce-cd23-47c7-be8c-e6abdb764f9b {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:16.065398 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd97cd93-6681-4758-9f89-2b21b54a16a5", "name": "network-vif-deleted", "tag": "5f6cd835-27b7-4eba-b1e4-30dd6f888de7", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:16.065675 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-654405ce-cd23-47c7-be8c-e6abdb764f9b {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:16.066214 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd97cd93-6681-4758-9f89-2b21b54a16a5', 'name': 'network-vif-deleted', 'tag': '5f6cd835-27b7-4eba-b1e4-30dd6f888de7', 'status': 'completed', 'code': 200}
Jun 01 11:11:16.119170 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-7144cb27-37b7-4e68-94a1-ed94d1be0109 req-c9a8f919-de81-4361-ade3-619de3bcf955 service neutron] 10.222.0.79 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2470622
Jun 01 11:11:16.270613 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-dd7c684f-2038-4437-b042-03c0c675a5c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:16.271835 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-dd7c684f-2038-4437-b042-03c0c675a5c1 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7e8afbfddd4f420185db35195f7b5d54&device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 1096 time: 0.0966048
Jun 01 11:11:16.459812 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-5883d3bf-6daf-476e-a319-27f8751fed52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:16.461341 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-5883d3bf-6daf-476e-a319-27f8751fed52 service neutron] 10.222.0.79 "GET /v2.0/networks?id=73f1ca3d-3f00-45a8-bb61-3d265d008491 HTTP/1.1" status: 200  len: 915 time: 0.1791179
Jun 01 11:11:16.552879 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:16.559054 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d10d87c-f7f3-430d-ad98-9020d1a5abcc req-549f99cb-230d-4005-a267-ab58e7d1d997 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:16.561124 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6d10d87c-f7f3-430d-ad98-9020d1a5abcc req-549f99cb-230d-4005-a267-ab58e7d1d997 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1985259
Jun 01 11:11:16.561848 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-ef404d8c-abb5-4553-a58b-b7ec57642039 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=66c448af-86b3-414d-8e93-0176f06e6420 HTTP/1.1" status: 200  len: 217 time: 0.0819914
Jun 01 11:11:16.641804 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device f6597bbf-8472-42e0-930e-7514f3d0f2d3 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:11:16.641981 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-9653e301-6229-45a4-ae89-70c9fadca123 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:16.643388 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-9653e301-6229-45a4-ae89-70c9fadca123 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/networks?id=7642d4f7-83cf-45f3-b430-803385a99096 HTTP/1.1" status: 200  len: 808 time: 0.2377501
Jun 01 11:11:16.651823 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-ecd00681-9813-4a01-a6e4-3ddcae287ff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:16.654322 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-ecd00681-9813-4a01-a6e4-3ddcae287ff2 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=3d925639-91b9-4f79-8619-2a656b4099a2 HTTP/1.1" status: 200  len: 854 time: 0.0815353
Jun 01 11:11:16.658694 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6d10d87c-f7f3-430d-ad98-9020d1a5abcc req-61193034-5ada-4614-8ab0-c43d1db9b42d tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0899875
Jun 01 11:11:16.697484 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: f6597bbf-8472-42e0-930e-7514f3d0f2d3 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:11:16.698312 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device f6597bbf-8472-42e0-930e-7514f3d0f2d3 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:11:16.698799 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-735d4ed9-67dc-4bf3-a540-5de47cbfbbd8 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/quotas/7bae65d9f7e14bd9a5a972ca94d43c3d HTTP/1.1" status: 200  len: 375 time: 0.0390074
Jun 01 11:11:16.699249 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:11:16.727103 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-546a583a-b092-43ee-921b-2c9c6cbc767b service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=73f1ca3d-3f00-45a8-bb61-3d265d008491&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0640492
Jun 01 11:11:16.742531 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:11:16.743099 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 5f6cd835-27b7-4eba-b1e4-30dd6f888de7 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:11:16.761499 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-dd6899c3-e2d9-4439-bc1e-643504d14dd2 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Synchronizing usage tracker for tenant:7bae65d9f7e14bd9a5a972ca94d43c3d on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:11:16.780815 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-dd6899c3-e2d9-4439-bc1e-643504d14dd2 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Unset dirty status for tenant:7bae65d9f7e14bd9a5a972ca94d43c3d on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:11:16.782168 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-dd6899c3-e2d9-4439-bc1e-643504d14dd2 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=7bae65d9f7e14bd9a5a972ca94d43c3d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0825694
Jun 01 11:11:16.830300 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 33470) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:16.915765 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-1ee27edc-f9f4-4f59-8375-34e40d20ad23 service neutron] 10.222.0.79 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1783168
Jun 01 11:11:16.945954 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-d47854f4-f1b6-4c5f-8c44-5b75c5f2b81c service neutron] 10.222.0.74 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1432521
Jun 01 11:11:17.015317 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:17.089419 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:17.103845 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Usage tracker for resource:security_group_rule and tenant:314ab773048649e3977b484131cd1e3d is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:17.108764 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-550e4228-de3a-4e1e-8961-fb2c0f4c319f req-d7f0859a-6269-4f9b-9048-a2c0e5ec8648 service neutron] 10.222.0.79 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1845775
Jun 01 11:11:17.110747 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:17.123144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:17.217602 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-1776bf07-69e1-4015-a6ef-7614fc209038 service neutron] 10.222.0.74 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2649796
Jun 01 11:11:17.291191 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a175f798-566c-4ff6-9b6f-ba452cb44dd6 req-f01e304f-7152-44a5-8229-d83439caad1c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:17.292931 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a175f798-566c-4ff6-9b6f-ba452cb44dd6 req-f01e304f-7152-44a5-8229-d83439caad1c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 943 time: 0.1792037
Jun 01 11:11:17.382660 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:17.410254 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:17.437059 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f9937a77-e1f2-4abb-9346-930f88974346 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:17.549409 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a175f798-566c-4ff6-9b6f-ba452cb44dd6 req-6788a136-8771-4872-98a3-939a810c581c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2408400
Jun 01 11:11:17.557691 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17972a12-8ff8-4b79-935d-14cb8636e88c,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:17.566270 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:17.592605 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 33532) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:17.592879 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=314ab773048649e3977b484131cd1e3d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7612696
Jun 01 11:11:17.621314 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c7446f-ffd0-466c-82d2-fa7ffc9d9b9e req-e6fb5997-07d8-43ae-9cfa-7dfb6c96b8de tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:17.622829 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-07c7446f-ffd0-466c-82d2-fa7ffc9d9b9e req-e6fb5997-07d8-43ae-9cfa-7dfb6c96b8de tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1472280
Jun 01 11:11:17.735338 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c7386c14-3dfd-4055-9449-17e7e95259b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:17.817715 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c7386c14-3dfd-4055-9449-17e7e95259b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:17.837982 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c1e0895a-cd2c-46be-b7c7-bd5a21a71a35 req-80b704c0-ad0a-4adc-bccc-ac71671f4df5 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 210 time: 0.1899612
Jun 01 11:11:17.862497 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-07c7446f-ffd0-466c-82d2-fa7ffc9d9b9e req-2e9d75f4-55ab-49e6-91c6-fc84a873d30b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2315512
Jun 01 11:11:17.941354 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c7386c14-3dfd-4055-9449-17e7e95259b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:17.952279 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6f621d87-11f7-451f-8e50-78b8f067bec3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:17.980310 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7386c14-3dfd-4055-9449-17e7e95259b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17972a12-8ff8-4b79-935d-14cb8636e88c,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:17.983660 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c7386c14-3dfd-4055-9449-17e7e95259b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:17.984180 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-c7386c14-3dfd-4055-9449-17e7e95259b5 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/17972a12-8ff8-4b79-935d-14cb8636e88c HTTP/1.1" status: 204  len: 168 time: 0.3906054
Jun 01 11:11:17.994407 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-c7386c14-3dfd-4055-9449-17e7e95259b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:18.088208 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29586199-7472-427b-9359-2d4d966faf87 req-db71bd50-c67e-4700-a7dd-51921bdb182a tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:18.090303 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-29586199-7472-427b-9359-2d4d966faf87 req-db71bd50-c67e-4700-a7dd-51921bdb182a tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1135685
Jun 01 11:11:18.148922 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-29586199-7472-427b-9359-2d4d966faf87 req-bbb76804-de60-4c76-9e5f-79456f66399d tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0519521
Jun 01 11:11:18.744056 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b5ca6bb-14b6-4cd2-8973-d9881474b21d req-77b9996a-cc72-4886-9e0a-cbaaee50f135 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:18.745521 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b5ca6bb-14b6-4cd2-8973-d9881474b21d req-77b9996a-cc72-4886-9e0a-cbaaee50f135 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 943 time: 0.0808873
Jun 01 11:11:18.792794 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b5ca6bb-14b6-4cd2-8973-d9881474b21d req-e93b8be5-362e-4800-b68f-0b70ee853f65 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411761
Jun 01 11:11:18.801202 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:11:18.979696 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d1777fbf-806a-4986-be53-32581e4e8c36 req-1849c160-070e-4108-be40-a38cd56c8ea9 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 210 time: 0.0481937
Jun 01 11:11:19.065126 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4de4c51-4c49-480f-b545-228191389a87 req-560ae941-f59d-4d22-bbd2-27137e3e3f7f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:19.066349 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f4de4c51-4c49-480f-b545-228191389a87 req-560ae941-f59d-4d22-bbd2-27137e3e3f7f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.0830603
Jun 01 11:11:19.111326 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f4de4c51-4c49-480f-b545-228191389a87 req-49c851a0-5e0a-47f6-a908-8d02db51708b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390604
Jun 01 11:11:19.353492 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d97495a-59d9-4b1b-813a-28bd43b703bc req-8afafab1-8da8-43e2-9299-aea6b1492230 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:19.354862 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8d97495a-59d9-4b1b-813a-28bd43b703bc req-8afafab1-8da8-43e2-9299-aea6b1492230 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0822992
Jun 01 11:11:19.399931 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8d97495a-59d9-4b1b-813a-28bd43b703bc req-975ed47d-5664-4ea8-919e-b3504fe64474 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393119
Jun 01 11:11:19.407839 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 66c448af-86b3-414d-8e93-0176f06e6420 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:11:19.545022 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 66c448af-86b3-414d-8e93-0176f06e6420, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=66c448af-86b3-414d-8e93-0176f06e6420,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:19.557845 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '66c448af-86b3-414d-8e93-0176f06e6420', 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491', 'port_id': '66c448af-86b3-414d-8e93-0176f06e6420', 'mac_address': 'fa:16:3e:5c:fc:72', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 685, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3d925639-91b9-4f79-8619-2a656b4099a2', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:11:19.614854 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:19.631374 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 66c448af-86b3-414d-8e93-0176f06e6420 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:11:19.646437 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 66c448af-86b3-414d-8e93-0176f06e6420, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=66c448af-86b3-414d-8e93-0176f06e6420,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:19.650320 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:19.652140 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:19.716259 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=66c448af-86b3-414d-8e93-0176f06e6420,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:19.719319 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:19.975875 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b10e9d3-af4e-42ea-8e21-49190488e233 req-38d7c5da-a1e7-4e9c-8fbf-e7df4790f386 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:19.977309 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3b10e9d3-af4e-42ea-8e21-49190488e233 req-38d7c5da-a1e7-4e9c-8fbf-e7df4790f386 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 944 time: 0.0782263
Jun 01 11:11:20.021743 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3b10e9d3-af4e-42ea-8e21-49190488e233 req-11ffcefc-0fe2-459e-b0c9-380884d7f24e tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381539
Jun 01 11:11:20.129843 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3a33327d-21ca-41d7-9761-13b77828fdcc req-edcb05b0-ca8d-4fe7-a3a8-bddfaba6138a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 210 time: 0.0459323
Jun 01 11:11:20.300692 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d32ee8ba-ae89-445d-8988-5365945c3558 req-760063e0-d524-455e-93f9-3dc3c2b9943a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:20.302149 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d32ee8ba-ae89-445d-8988-5365945c3558 req-760063e0-d524-455e-93f9-3dc3c2b9943a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.0796931
Jun 01 11:11:20.346163 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d32ee8ba-ae89-445d-8988-5365945c3558 req-765bdba9-7264-4f5e-a2a0-20ed0806f968 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385115
Jun 01 11:11:20.589229 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8d6d12-46b9-4391-9f1e-97b39d64075d req-72961339-6fcb-4f95-84fc-9e7706481c15 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:20.590719 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7d8d6d12-46b9-4391-9f1e-97b39d64075d req-72961339-6fcb-4f95-84fc-9e7706481c15 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0835228
Jun 01 11:11:20.634297 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7d8d6d12-46b9-4391-9f1e-97b39d64075d req-637d09a8-b4ac-426b-99a5-d236963da299 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0379441
Jun 01 11:11:21.204503 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc668bbf-49e3-4371-bdc1-b198c3a9d835 req-b4cd7eba-1824-4236-98b2-f043ea96e6d1 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:21.205963 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cc668bbf-49e3-4371-bdc1-b198c3a9d835 req-b4cd7eba-1824-4236-98b2-f043ea96e6d1 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 944 time: 0.0787427
Jun 01 11:11:21.292341 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-31a73e16-a397-438c-8e8d-0a0ff629ff72 req-a6478579-8c24-4af2-8fa8-f54676f769a7 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 210 time: 0.0530560
Jun 01 11:11:21.295854 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cc668bbf-49e3-4371-bdc1-b198c3a9d835 req-7d46ea62-52fd-4e03-87e8-7bbe3cc4842b tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0843036
Jun 01 11:11:21.538725 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c17ac3f5-1dcd-4d45-a61e-031a6f32a864 req-4f21c74c-2ff3-4230-a710-8ac92c13f489 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:21.540238 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c17ac3f5-1dcd-4d45-a61e-031a6f32a864 req-4f21c74c-2ff3-4230-a710-8ac92c13f489 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.0834827
Jun 01 11:11:21.587729 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c17ac3f5-1dcd-4d45-a61e-031a6f32a864 req-f2541a69-4075-4e4f-96d7-315696bb57cb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404985
Jun 01 11:11:21.608519 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-322c69e1-e409-45f8-ba5c-ad4f57ffc3e2 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:21.610211 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-322c69e1-e409-45f8-ba5c-ad4f57ffc3e2 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.79 "GET /v2.0/networks?id=7642d4f7-83cf-45f3-b430-803385a99096 HTTP/1.1" status: 200  len: 808 time: 0.1716654
Jun 01 11:11:21.637804 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Request body: {'port': {'device_id': 'c040b44e-1b79-49b4-a1af-cba37e481a47', 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096', 'admin_state_up': True, 'tenant_id': '7bae65d9f7e14bd9a5a972ca94d43c3d'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:21.758696 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['66c448af-86b3-414d-8e93-0176f06e6420'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:11:21.788624 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:21.801285 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:21.812483 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Made reservation on behalf of 7bae65d9f7e14bd9a5a972ca94d43c3d for: {'port': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:11:21.815969 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:21.829676 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0ddaa7-67e3-47a7-a106-563ccf18a9a5 req-83bcf4ae-225b-435c-93a7-fcfaa71f24fa tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:21.831469 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6f0ddaa7-67e3-47a7-a106-563ccf18a9a5 req-83bcf4ae-225b-435c-93a7-fcfaa71f24fa tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0888612
Jun 01 11:11:21.877607 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6f0ddaa7-67e3-47a7-a106-563ccf18a9a5 req-5ddbe897-8392-48d6-af39-e00f3fd924ed tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394464
Jun 01 11:11:21.983968 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Allocated IP 172.20.0.9 (7642d4f7-83cf-45f3-b430-803385a99096/1dfa662b-3182-4cf1-aa42-e313e271a7a1/1f3a7c73-8f1f-4696-9d4b-578f9092a68b) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:11:22.196048 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:22.225100 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:22.230269 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:22.362444 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Network 7642d4f7-83cf-45f3-b430-803385a99096 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:22.365652 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:22.369344 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:11:22.420244 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Pushing event updated for resources: {'Port': ['ID=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:22.424798 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:22.440987 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:22.441592 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:22.468973 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-5554b8e6-a585-4819-a1e6-f45047a2679c tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8357153
Jun 01 11:11:22.487299 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Request body: {'port': {'device_id': 'c040b44e-1b79-49b4-a1af-cba37e481a47', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:22.571203 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686e0359-7372-442e-b8c8-af959fbacc20 req-402139cb-dc01-4650-a223-21a3e96f8b3f tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:22.573522 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-686e0359-7372-442e-b8c8-af959fbacc20 req-402139cb-dc01-4650-a223-21a3e96f8b3f tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 931 time: 0.1213200
Jun 01 11:11:22.586946 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ac7791-cbb7-42f2-a622-a0b0e7d4c85a req-0ad3c6a4-df10-4e19-9bf8-31b5d9f7e436 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:22.593930 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a2ac7791-cbb7-42f2-a622-a0b0e7d4c85a req-0ad3c6a4-df10-4e19-9bf8-31b5d9f7e436 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 944 time: 0.1827571
Jun 01 11:11:22.650241 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:22.708885 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a2ac7791-cbb7-42f2-a622-a0b0e7d4c85a req-2eae370a-39ab-4909-bf1c-5be342870f92 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1139095
Jun 01 11:11:22.712924 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-15f03e89-7774-4d40-b383-c0505ad78d3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:22.728827 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-686e0359-7372-442e-b8c8-af959fbacc20 req-a1610a84-3745-425a-9a2e-10dd261becd0 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1320922
Jun 01 11:11:22.987914 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77cff926-b162-4c89-a858-9a616bb3fed8 req-28db66b1-ba04-4bf8-8e38-bf00068d33bb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:22.995846 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 33680) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:23.001541 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-77cff926-b162-4c89-a858-9a616bb3fed8 req-28db66b1-ba04-4bf8-8e38-bf00068d33bb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1484201
Jun 01 11:11:23.097522 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-77cff926-b162-4c89-a858-9a616bb3fed8 req-d3472d2b-e745-4eb7-a8b3-a892d0cc0aab tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0903184
Jun 01 11:11:23.149077 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-591c3256-a53c-4f1b-8c2f-ba7005b1fad2 req-f5a6b71d-6e2f-4587-8ce9-01731cc5608f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:23.156770 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-591c3256-a53c-4f1b-8c2f-ba7005b1fad2 req-f5a6b71d-6e2f-4587-8ce9-01731cc5608f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1184936
Jun 01 11:11:23.213887 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-591c3256-a53c-4f1b-8c2f-ba7005b1fad2 req-79b679d0-c6f8-42d6-a5af-771580f0f906 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0560470
Jun 01 11:11:23.221081 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f3a7c73-8f1f-4696-9d4b-578f9092a68b {{(pid=119240) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:11:23.230869 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.247185 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Transition to ACTIVE for port object 1f3a7c73-8f1f-4696-9d4b-578f9092a68b will not be triggered until provisioned by entity L2. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:23.270290 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.276720 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:23.339554 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 66c448af-86b3-414d-8e93-0176f06e6420 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:23.445103 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 66c448af-86b3-414d-8e93-0176f06e6420 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:23.457436 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 66c448af-86b3-414d-8e93-0176f06e6420 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:23.458086 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.472446 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Pushing event updated for resources: {'Port': ['ID=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:23.485719 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7c5dd092-619f-45b6-a45d-ced0955ea2df admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=b19729a90cd64079a3b4ea484c538a0d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4780619
Jun 01 11:11:23.485719 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:23.485719 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 33694) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:23.605035 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Attempting to bind port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:11:23.605369 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Attempting to bind port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '50169f53-532c-4126-a49b-bd813455458e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 681, 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096'}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:11:23.605730 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Attempting to bind port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b on network 7642d4f7-83cf-45f3-b430-803385a99096 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:23.614592 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b on network 7642d4f7-83cf-45f3-b430-803385a99096 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:11:23.614913 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Attempting to bind port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b on network 7642d4f7-83cf-45f3-b430-803385a99096 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:23.620041 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-55d8b498-0077-4c82-9046-329640fae254 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.624658 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 11, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:11:23.624999 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Checking segment: {'id': '50169f53-532c-4126-a49b-bd813455458e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 681, 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:23.625373 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Bound using segment: {'id': '50169f53-532c-4126-a49b-bd813455458e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 681, 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096'} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:11:23.625799 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Bound port: 1f3a7c73-8f1f-4696-9d4b-578f9092a68b, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '50169f53-532c-4126-a49b-bd813455458e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 681, 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096'}}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:11:23.626135 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.639706 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.669518 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '162fa94a-e72c-4955-b021-ee4d6defe252', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66c448af-86b3-414d-8e93-0176f06e6420'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:23.671937 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-888ea729-97cc-4cba-af04-0c24bfca7ba0" -d '{"events": [{"server_uuid": "162fa94a-e72c-4955-b021-ee4d6defe252", "name": "network-vif-plugged", "status": "completed", "tag": "66c448af-86b3-414d-8e93-0176f06e6420"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:23.694139 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 66c448af-86b3-414d-8e93-0176f06e6420, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=66c448af-86b3-414d-8e93-0176f06e6420,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:23.705236 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.707396 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:23.708054 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-55d8b498-0077-4c82-9046-329640fae254 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.745243 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97d855f2-7460-42ac-beb5-7fd0c1caff47 x-openstack-request-id: req-97d855f2-7460-42ac-beb5-7fd0c1caff47 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:23.745368 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "162fa94a-e72c-4955-b021-ee4d6defe252", "name": "network-vif-plugged", "status": "completed", "tag": "66c448af-86b3-414d-8e93-0176f06e6420", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:23.745607 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-97d855f2-7460-42ac-beb5-7fd0c1caff47 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:23.746002 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '162fa94a-e72c-4955-b021-ee4d6defe252', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66c448af-86b3-414d-8e93-0176f06e6420', 'code': 200}
Jun 01 11:11:23.796218 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=66c448af-86b3-414d-8e93-0176f06e6420,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:23.796766 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] For port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b, host hv-cinder-78776, cleared binding levels {{(pid=119240) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:11:23.800096 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:23.807293 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] For port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119240) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:11:23.812988 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.819626 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9ea42620-8274-4b8f-9369-09926f198158 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:23.882276 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:23.882886 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.884517 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] 10.222.0.79 "PUT /v2.0/ports/1f3a7c73-8f1f-4696-9d4b-578f9092a68b HTTP/1.1" status: 200  len: 1093 time: 1.4029336
Jun 01 11:11:23.886232 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c040b44e-1b79-49b4-a1af-cba37e481a47', 'tag': '1f3a7c73-8f1f-4696-9d4b-578f9092a68b'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:23.888611 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad" -d '{"events": [{"name": "network-changed", "server_uuid": "c040b44e-1b79-49b4-a1af-cba37e481a47", "tag": "1f3a7c73-8f1f-4696-9d4b-578f9092a68b"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:23.890509 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eedc286-1069-4454-a1d1-9171072fde15 req-11b6926b-2e02-4c9c-a306-03453ba1f554 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:23.891944 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eedc286-1069-4454-a1d1-9171072fde15 req-11b6926b-2e02-4c9c-a306-03453ba1f554 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1099 time: 0.2757359
Jun 01 11:11:23.896201 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-55d8b498-0077-4c82-9046-329640fae254 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.916090 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-55d8b498-0077-4c82-9046-329640fae254 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:23.921125 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-55d8b498-0077-4c82-9046-329640fae254 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/3f2c013b-8aed-4648-84e8-5a1b5e7518df HTTP/1.1" status: 204  len: 168 time: 0.4004080
Jun 01 11:11:23.921125 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Pushing event updated for resources: {'Port': ['ID=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,revision_number=3']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:23.928496 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:23.929196 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-71c4104b-d1e1-4b2c-8ce7-7483f7da9de6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.024s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:23.976780 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55d8b498-0077-4c82-9046-329640fae254 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f2c013b-8aed-4648-84e8-5a1b5e7518df,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:23.983961 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-55d8b498-0077-4c82-9046-329640fae254 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:24.021880 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-4f8025f8-312c-468f-b4c5-1fdfa68cc80d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:24.023358 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-4f8025f8-312c-468f-b4c5-1fdfa68cc80d service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7bae65d9f7e14bd9a5a972ca94d43c3d&device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 1096 time: 0.0841272
Jun 01 11:11:24.034083 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe0b0e4-11a0-4bae-9fbb-9531b3f6c092 req-5ee58e23-7804-434d-8a2a-55ddb508753a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:24.035503 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cbe0b0e4-11a0-4bae-9fbb-9531b3f6c092 req-5ee58e23-7804-434d-8a2a-55ddb508753a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.3740816
Jun 01 11:11:24.114975 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-3373555b-a23b-4aa9-88b9-4cb6cb3904f1 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1f3a7c73-8f1f-4696-9d4b-578f9092a68b HTTP/1.1" status: 200  len: 217 time: 0.0701282
Jun 01 11:11:24.196017 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-a3d93784-dd09-441f-bdcc-9c372659cabf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:24.197526 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-a3d93784-dd09-441f-bdcc-9c372659cabf service neutron] 10.222.0.79 "GET /v2.0/subnets?id=1dfa662b-3182-4cf1-aa42-e313e271a7a1 HTTP/1.1" status: 200  len: 848 time: 0.0688002
Jun 01 11:11:24.205642 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cbe0b0e4-11a0-4bae-9fbb-9531b3f6c092 req-b61e02d1-fd88-431d-b605-9dfe913d6fef tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1213205
Jun 01 11:11:24.220344 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eedc286-1069-4454-a1d1-9171072fde15 req-12cf9a57-7ccd-468e-a523-6f88d55b5da3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:24.221692 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eedc286-1069-4454-a1d1-9171072fde15 req-12cf9a57-7ccd-468e-a523-6f88d55b5da3 service neutron] 10.222.0.79 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 919 time: 0.2909274
Jun 01 11:11:24.245590 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a3bcffd-34ee-4473-b76f-0e614c4f1a86 req-24e313d5-bc51-4a0d-bd3f-f69b27aeec22 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:24.247395 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7a3bcffd-34ee-4473-b76f-0e614c4f1a86 req-24e313d5-bc51-4a0d-bd3f-f69b27aeec22 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 945 time: 0.3523557
Jun 01 11:11:24.260909 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-053fb64d-ae9f-438c-9dda-cde46947c2a5 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7642d4f7-83cf-45f3-b430-803385a99096&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0489979
Jun 01 11:11:24.353235 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560a610e-5a53-4336-a301-59f7aa4d6ab8 req-90eead3e-6852-43d1-a255-79e8a8ba84b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:24.354680 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-560a610e-5a53-4336-a301-59f7aa4d6ab8 req-90eead3e-6852-43d1-a255-79e8a8ba84b5 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 1098 time: 0.3293626
Jun 01 11:11:24.355931 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eedc286-1069-4454-a1d1-9171072fde15 req-33884c84-79a5-4aea-8eb5-cf1d68785038 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24 HTTP/1.1" status: 200  len: 217 time: 0.1074300
Jun 01 11:11:24.409369 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-b954c834-0517-4026-9b5c-0d888ad7fca6 service neutron] 10.222.0.79 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1404586
Jun 01 11:11:24.518442 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7a3bcffd-34ee-4473-b76f-0e614c4f1a86 req-b852c78d-f3cc-449f-b454-ba64aa24be89 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2069347
Jun 01 11:11:24.532047 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-560a610e-5a53-4336-a301-59f7aa4d6ab8 req-26edde72-1368-44a7-9466-970a8249e8d2 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1431224
Jun 01 11:11:24.547518 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eedc286-1069-4454-a1d1-9171072fde15 req-768f9ccc-0770-439a-933b-27fc52e61c75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:24.549037 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eedc286-1069-4454-a1d1-9171072fde15 req-768f9ccc-0770-439a-933b-27fc52e61c75 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 200  len: 858 time: 0.1572783
Jun 01 11:11:24.576512 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3619dc-4559-4225-979b-4e063fa5623d req-59ba98f4-9e81-4e8e-b3bb-b15929ba4579 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:24.584865 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dd3619dc-4559-4225-979b-4e063fa5623d req-59ba98f4-9e81-4e8e-b3bb-b15929ba4579 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 943 time: 0.2364037
Jun 01 11:11:24.661269 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-8177fb45-3177-45da-b43a-8e0bd29ea5cd req-3dd5f8e4-fb95-429e-aace-e7a704ba3e92 service neutron] 10.222.0.79 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2417767
Jun 01 11:11:24.662653 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d805f1d0-39aa-41c8-b993-bcdfcccbf394 x-openstack-request-id: req-d805f1d0-39aa-41c8-b993-bcdfcccbf394 {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:24.662972 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c040b44e-1b79-49b4-a1af-cba37e481a47", "tag": "1f3a7c73-8f1f-4696-9d4b-578f9092a68b", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:24.663250 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-d805f1d0-39aa-41c8-b993-bcdfcccbf394 {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:24.663673 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c040b44e-1b79-49b4-a1af-cba37e481a47', 'tag': '1f3a7c73-8f1f-4696-9d4b-578f9092a68b', 'status': 'completed', 'code': 200}
Jun 01 11:11:24.670560 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eedc286-1069-4454-a1d1-9171072fde15 req-a6dd9026-3dd3-49f8-9fb0-0f780235717c service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=e8c7dea7-722b-446b-9e9f-d27643e48187&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0495863
Jun 01 11:11:24.682755 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dd3619dc-4559-4225-979b-4e063fa5623d req-34ff9e65-3cd6-4d93-8833-fe9380d6810e tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0967193
Jun 01 11:11:24.884641 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-66e34692-a290-4f71-a88d-19dcf0ee47ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:24.886295 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-66e34692-a290-4f71-a88d-19dcf0ee47ca service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7bae65d9f7e14bd9a5a972ca94d43c3d&device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 1096 time: 0.1185808
Jun 01 11:11:24.994627 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eedc286-1069-4454-a1d1-9171072fde15 req-f881d078-a0c7-462d-9d30-146fe0305247 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3043387
Jun 01 11:11:25.098493 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c8aa517-4b83-4531-91f8-eb0b6bf0aa7d req-faa31c39-b252-4638-ba24-55760b51e7dd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:25.099520 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1c8aa517-4b83-4531-91f8-eb0b6bf0aa7d req-faa31c39-b252-4638-ba24-55760b51e7dd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2820139
Jun 01 11:11:25.114796 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf2611b-7dac-410d-b73a-93fe85138107 req-55f05c75-a45b-4467-a3fc-b03c54590fd0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:25.116250 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dcf2611b-7dac-410d-b73a-93fe85138107 req-55f05c75-a45b-4467-a3fc-b03c54590fd0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.2935636
Jun 01 11:11:25.123425 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-20d11fe5-fd66-4dad-b5ec-c5b898c60491 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:25.125091 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-20d11fe5-fd66-4dad-b5ec-c5b898c60491 service neutron] 10.222.0.79 "GET /v2.0/networks?id=7642d4f7-83cf-45f3-b430-803385a99096 HTTP/1.1" status: 200  len: 909 time: 0.1313951
Jun 01 11:11:25.196214 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-2b50c7da-62ce-4ea2-ba1f-e7c6dcb84fc8 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1f3a7c73-8f1f-4696-9d4b-578f9092a68b HTTP/1.1" status: 200  len: 217 time: 0.0630248
Jun 01 11:11:25.226158 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1c8aa517-4b83-4531-91f8-eb0b6bf0aa7d req-9977de98-6e3b-44b0-9e69-6053a000f6da tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1069360
Jun 01 11:11:25.240209 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a9abf75e-304b-4c24-a517-ab6e379a562a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:25.254906 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eedc286-1069-4454-a1d1-9171072fde15 req-9341914e-428d-4e9d-8a9c-297969af8d25 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2499576
Jun 01 11:11:25.267469 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dcf2611b-7dac-410d-b73a-93fe85138107 req-b58d12ed-1838-4a5c-8e31-0ada31681b71 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1300409
Jun 01 11:11:25.284064 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-9e3a7170-b464-4441-a837-2c0e1d0c642a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:25.285780 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-9e3a7170-b464-4441-a837-2c0e1d0c642a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=1dfa662b-3182-4cf1-aa42-e313e271a7a1 HTTP/1.1" status: 200  len: 848 time: 0.0819151
Jun 01 11:11:25.329688 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:25.361770 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-a62fe376-8c7d-454e-a323-35945a588467 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7642d4f7-83cf-45f3-b430-803385a99096&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0630667
Jun 01 11:11:25.427322 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29bfa0e4-1ba3-4c9f-9af8-792138e5f83a req-3a893ec2-d902-4008-a649-de5b16e9ac7f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:25.428822 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-29bfa0e4-1ba3-4c9f-9af8-792138e5f83a req-3a893ec2-d902-4008-a649-de5b16e9ac7f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0920630
Jun 01 11:11:25.474880 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-29bfa0e4-1ba3-4c9f-9af8-792138e5f83a req-33eacf2a-8354-47ee-bf78-a342e09fcea0 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395138
Jun 01 11:11:25.516016 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-7d66540e-a31d-4651-b0e0-5c25426d5a6f service neutron] 10.222.0.79 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1398573
Jun 01 11:11:25.662229 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c78c5434-9cea-4fdc-8cf7-2afc29d6bcad req-77205486-30d6-4ddc-9c7b-31814067fe82 service neutron] 10.222.0.79 "GET /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1394312
Jun 01 11:11:25.726432 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5d055a-9e9b-4183-9c86-b6ad68dfcf36 req-d5e01ca3-a5a8-4a43-b2b8-fa36c60591c2 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:25.728090 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa5d055a-9e9b-4183-9c86-b6ad68dfcf36 req-d5e01ca3-a5a8-4a43-b2b8-fa36c60591c2 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 945 time: 0.0975089
Jun 01 11:11:25.796130 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa5d055a-9e9b-4183-9c86-b6ad68dfcf36 req-ffd52547-c7d4-41c2-bacc-a82a05472736 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0610840
Jun 01 11:11:25.876540 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe618194-49d8-48d6-9296-f48e0a68d7ec req-0bee72e3-2bca-4d81-ac49-4c0fb75fc6bf tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:25.877910 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fe618194-49d8-48d6-9296-f48e0a68d7ec req-0bee72e3-2bca-4d81-ac49-4c0fb75fc6bf tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 943 time: 0.0807397
Jun 01 11:11:25.926299 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fe618194-49d8-48d6-9296-f48e0a68d7ec req-5e825b17-efc6-469d-9edb-00b2216b70a2 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418711
Jun 01 11:11:26.373970 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:26.479780 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38390138-d27f-44cd-acb6-77a392c10505 req-935a72d4-a6ee-4a41-8c69-d006b3466208 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:26.482512 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-38390138-d27f-44cd-acb6-77a392c10505 req-935a72d4-a6ee-4a41-8c69-d006b3466208 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1449606
Jun 01 11:11:26.510578 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626db1fa-cf24-4724-9774-31e02ceda8eb req-07e22485-a272-449f-bf7c-7c5c9af8344b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:26.512521 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-626db1fa-cf24-4724-9774-31e02ceda8eb req-07e22485-a272-449f-bf7c-7c5c9af8344b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1182883
Jun 01 11:11:26.564078 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-38390138-d27f-44cd-acb6-77a392c10505 req-17def51c-22ce-4ef0-aa5e-828b61adfd84 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0739059
Jun 01 11:11:26.573476 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-626db1fa-cf24-4724-9774-31e02ceda8eb req-8fe827ef-7e22-4201-b40b-77739b2b78fa tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0537090
Jun 01 11:11:26.826857 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c037f94-b751-4368-9763-aa073183954d req-54b672ed-03e9-4231-8969-db593ce924e1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:26.828367 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2c037f94-b751-4368-9763-aa073183954d req-54b672ed-03e9-4231-8969-db593ce924e1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1666858
Jun 01 11:11:26.873984 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2c037f94-b751-4368-9763-aa073183954d req-bed9f1d2-ec8f-42d4-a739-fe0cc8c67e63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398135
Jun 01 11:11:26.995544 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6262af3-e893-469d-9879-29b7fcb66eac req-5d981625-a77e-4fa6-b9f2-600c8a469bcd tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:26.998372 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6262af3-e893-469d-9879-29b7fcb66eac req-5d981625-a77e-4fa6-b9f2-600c8a469bcd tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 945 time: 0.0843272
Jun 01 11:11:27.082646 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6262af3-e893-469d-9879-29b7fcb66eac req-11e75978-c6d9-4ee9-974e-18a9a5fee176 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0780218
Jun 01 11:11:27.124969 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb3a9e32-de4f-4f3e-aa0d-78dbc42cd02a req-a93e3555-caa9-41a5-a76f-13fb543c9705 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:27.126447 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fb3a9e32-de4f-4f3e-aa0d-78dbc42cd02a req-a93e3555-caa9-41a5-a76f-13fb543c9705 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 943 time: 0.0889010
Jun 01 11:11:27.180423 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fb3a9e32-de4f-4f3e-aa0d-78dbc42cd02a req-c8b6036a-4285-4208-b9a1-1ca326f2b9fe tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469079
Jun 01 11:11:27.355090 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 1f3a7c73-8f1f-4696-9d4b-578f9092a68b details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:11:27.499745 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:27.514855 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '1f3a7c73-8f1f-4696-9d4b-578f9092a68b', 'network_id': '7642d4f7-83cf-45f3-b430-803385a99096', 'port_id': '1f3a7c73-8f1f-4696-9d4b-578f9092a68b', 'mac_address': 'fa:16:3e:cc:83:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1dfa662b-3182-4cf1-aa42-e313e271a7a1', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:11:27.575750 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:27.596325 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f3a7c73-8f1f-4696-9d4b-578f9092a68b {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:11:27.616057 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:27.622422 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:27.628412 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:27.743080 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:27.746849 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:27.749920 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:27.940908 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301c5036-04ed-4dc5-a397-8d1d9cdd37af req-5950d488-9a25-464e-a1f5-14bc8397bbfe tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:27.942542 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-301c5036-04ed-4dc5-a397-8d1d9cdd37af req-5950d488-9a25-464e-a1f5-14bc8397bbfe tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1131916
Jun 01 11:11:27.955150 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0c0093-588b-46ba-a390-23647994c45a req-d5370693-f7e2-4a3f-9680-8a03aa2333f7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:27.955150 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd0c0093-588b-46ba-a390-23647994c45a req-d5370693-f7e2-4a3f-9680-8a03aa2333f7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1618145
Jun 01 11:11:28.024412 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-301c5036-04ed-4dc5-a397-8d1d9cdd37af req-0b221a1a-52ad-4456-a28f-fa247bf74af8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0714641
Jun 01 11:11:28.029365 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd0c0093-588b-46ba-a390-23647994c45a req-1910bdbd-6b1b-4020-b736-f44cfdaf8a52 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0624425
Jun 01 11:11:28.210703 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c050cf4-88a0-4ea5-915a-3034ccff4c9b req-68f5038f-5b63-4f49-82b2-dda95b7df233 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:28.212189 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4c050cf4-88a0-4ea5-915a-3034ccff4c9b req-68f5038f-5b63-4f49-82b2-dda95b7df233 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0799322
Jun 01 11:11:28.260283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4c050cf4-88a0-4ea5-915a-3034ccff4c9b req-f7dd8a5f-d5e3-4004-9bdd-5fa880929a27 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385573
Jun 01 11:11:28.371107 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dfe5e48-8885-4609-a9c7-587a2f85e3d6 req-e1ef3398-cc20-4c88-a116-da18703fe45d tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:28.373212 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9dfe5e48-8885-4609-a9c7-587a2f85e3d6 req-e1ef3398-cc20-4c88-a116-da18703fe45d tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 944 time: 0.0817542
Jun 01 11:11:28.416574 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9dfe5e48-8885-4609-a9c7-587a2f85e3d6 req-83535859-da52-494e-8d04-c6f532dad196 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0376997
Jun 01 11:11:29.278240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994c8255-b9e2-4137-9111-7e67d5f7f978 req-e154b8da-f4c3-43a9-83fb-82a91623808f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:29.279713 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-994c8255-b9e2-4137-9111-7e67d5f7f978 req-e154b8da-f4c3-43a9-83fb-82a91623808f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1402981
Jun 01 11:11:29.289665 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d6cd1dc-b53e-4073-9641-43150a40a5a5 req-681c0fb9-6622-422b-8bc9-2b0bd4dc3f7f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:29.291003 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4d6cd1dc-b53e-4073-9641-43150a40a5a5 req-681c0fb9-6622-422b-8bc9-2b0bd4dc3f7f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1196730
Jun 01 11:11:29.356468 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-994c8255-b9e2-4137-9111-7e67d5f7f978 req-361c3265-b1f1-4c7f-9308-12d446a86932 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0644703
Jun 01 11:11:29.363204 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4d6cd1dc-b53e-4073-9641-43150a40a5a5 req-ad547447-100f-486c-9b27-0f72d1057dbb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0588281
Jun 01 11:11:29.583689 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80bba14f-d989-4dff-929c-4898df038859 req-69e4ed2e-855f-401a-a02f-48a92378894c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:29.585042 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-80bba14f-d989-4dff-929c-4898df038859 req-69e4ed2e-855f-401a-a02f-48a92378894c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1298172
Jun 01 11:11:29.641547 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c9c6982-952d-42ac-8750-d4e02044a065 req-89b4318e-1d0b-429f-8074-ad09aa15f6b7 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:29.642868 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3c9c6982-952d-42ac-8750-d4e02044a065 req-89b4318e-1d0b-429f-8074-ad09aa15f6b7 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 944 time: 0.1211967
Jun 01 11:11:29.647218 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-80bba14f-d989-4dff-929c-4898df038859 req-16dd0204-d3f6-4217-9984-a5e85779affb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0555575
Jun 01 11:11:29.689571 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3c9c6982-952d-42ac-8750-d4e02044a065 req-e985ff33-676b-46ae-9e75-4040dc09964a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411386
Jun 01 11:11:30.610852 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ccce613-aa7b-4b32-9cbb-fb68b7996a55 req-d038728b-96ab-4e6a-8b1a-30871f2f4816 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:30.612319 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3ccce613-aa7b-4b32-9cbb-fb68b7996a55 req-d038728b-96ab-4e6a-8b1a-30871f2f4816 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1434681
Jun 01 11:11:30.620047 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8f3ecd-a175-4812-a8bd-b4acfbb67411 req-37ba6a93-8a67-413c-a340-13a4975d47d2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:30.621384 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8b8f3ecd-a175-4812-a8bd-b4acfbb67411 req-37ba6a93-8a67-413c-a340-13a4975d47d2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1222434
Jun 01 11:11:30.694545 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3ccce613-aa7b-4b32-9cbb-fb68b7996a55 req-4159adf7-8b9e-44f8-848d-7ec910f863a7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0722353
Jun 01 11:11:30.697445 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8b8f3ecd-a175-4812-a8bd-b4acfbb67411 req-e0994158-a3db-48d9-84fe-5c61042cac21 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0606501
Jun 01 11:11:30.802655 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['1f3a7c73-8f1f-4696-9d4b-578f9092a68b'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:11:30.946900 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-760a8490-7ea6-43f2-8e0d-611d347f4199 req-36bec793-a8c5-4188-8b19-a22a9959c670 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:30.948438 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-760a8490-7ea6-43f2-8e0d-611d347f4199 req-36bec793-a8c5-4188-8b19-a22a9959c670 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1513412
Jun 01 11:11:30.960575 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1abe10-e280-4a4d-8f20-09e648936ad6 req-23737cb3-c881-40b2-9053-af681dd9e31a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:30.961990 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-be1abe10-e280-4a4d-8f20-09e648936ad6 req-23737cb3-c881-40b2-9053-af681dd9e31a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 944 time: 0.1320992
Jun 01 11:11:31.038376 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-be1abe10-e280-4a4d-8f20-09e648936ad6 req-edcdcf3a-1fdd-46ed-9067-2b7f3156bbab tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0627759
Jun 01 11:11:31.041106 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-760a8490-7ea6-43f2-8e0d-611d347f4199 req-50945574-b3ed-4418-ba9e-ee2e485417ec tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0782611
Jun 01 11:11:31.949711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68fa2b9-b438-4b09-bba1-8d3cf1967ae4 req-9dd18221-0ab9-4d80-a276-d4915fe5bd58 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:31.951145 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c68fa2b9-b438-4b09-bba1-8d3cf1967ae4 req-9dd18221-0ab9-4d80-a276-d4915fe5bd58 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1395922
Jun 01 11:11:31.962444 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6186ced9-893a-4d33-a360-5c59f8081713 req-63ce675a-4ccd-4e10-979d-d3fcf35ff668 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:31.963903 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6186ced9-893a-4d33-a360-5c59f8081713 req-63ce675a-4ccd-4e10-979d-d3fcf35ff668 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1129005
Jun 01 11:11:32.117277 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6186ced9-893a-4d33-a360-5c59f8081713 req-9da04264-7887-428c-b2b6-6bcdfe95ee78 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1398139
Jun 01 11:11:32.119949 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c68fa2b9-b438-4b09-bba1-8d3cf1967ae4 req-168f1ee8-87dc-4c99-b14f-2de6c01a08a3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1551707
Jun 01 11:11:32.371478 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c02ef2c-197b-40ee-9bf0-e601cbca4bb8 req-0a6cdac4-1ea9-4f46-aa0c-865ace6dbbfc tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:32.372995 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6c02ef2c-197b-40ee-9bf0-e601cbca4bb8 req-0a6cdac4-1ea9-4f46-aa0c-865ace6dbbfc tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 944 time: 0.1462815
Jun 01 11:11:32.381481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0997f04-20e4-40b0-8d12-bdef89eeda1e req-7c9406af-eade-4fe2-aa62-f9e921abc53d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:32.383067 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e0997f04-20e4-40b0-8d12-bdef89eeda1e req-7c9406af-eade-4fe2-aa62-f9e921abc53d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1239462
Jun 01 11:11:32.388969 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 1f3a7c73-8f1f-4696-9d4b-578f9092a68b up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:32.455282 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6c02ef2c-197b-40ee-9bf0-e601cbca4bb8 req-46fd837d-b85e-4b38-af8a-1e71aaa587bc tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0710328
Jun 01 11:11:32.462583 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e0997f04-20e4-40b0-8d12-bdef89eeda1e req-f9499e2b-1253-4e0a-9857-4f1716beea15 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0641329
Jun 01 11:11:32.489321 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:32.493795 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:32.494177 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:32.613925 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:32.642755 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c040b44e-1b79-49b4-a1af-cba37e481a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f3a7c73-8f1f-4696-9d4b-578f9092a68b'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:32.645124 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00807c69-2cc6-464d-9b06-111690384ab5" -d '{"events": [{"server_uuid": "c040b44e-1b79-49b4-a1af-cba37e481a47", "name": "network-vif-plugged", "status": "completed", "tag": "1f3a7c73-8f1f-4696-9d4b-578f9092a68b"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:32.654383 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:32.658808 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:32.661742 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:32.693072 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e17f837-9110-4bbf-b1d9-8e194f4b02f6 x-openstack-request-id: req-8e17f837-9110-4bbf-b1d9-8e194f4b02f6 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:32.693334 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c040b44e-1b79-49b4-a1af-cba37e481a47", "name": "network-vif-plugged", "status": "completed", "tag": "1f3a7c73-8f1f-4696-9d4b-578f9092a68b", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:32.693749 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-8e17f837-9110-4bbf-b1d9-8e194f4b02f6 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:32.704200 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c040b44e-1b79-49b4-a1af-cba37e481a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f3a7c73-8f1f-4696-9d4b-578f9092a68b', 'code': 200}
Jun 01 11:11:32.745117 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:32.747996 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:32.935031 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0be58b8-6710-4560-bd36-4bfc33bcff19 req-2e1101c5-042f-4a9e-8566-1d5b7c1318f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:32.936506 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f0be58b8-6710-4560-bd36-4bfc33bcff19 req-2e1101c5-042f-4a9e-8566-1d5b7c1318f1 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 1098 time: 0.0806942
Jun 01 11:11:32.980787 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-f0be58b8-6710-4560-bd36-4bfc33bcff19 req-452e638b-bedf-491d-bd27-b1111316e17a service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0361969
Jun 01 11:11:33.394490 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b5e07f-baff-46c0-b6d1-2bff3794db62 req-bacf27a2-5c65-4e6a-9e81-93ea2d82a85e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:33.395945 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b4b5e07f-baff-46c0-b6d1-2bff3794db62 req-bacf27a2-5c65-4e6a-9e81-93ea2d82a85e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1410477
Jun 01 11:11:33.407950 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aefc95f-ca06-4365-9ecc-153f23cda139 req-98c7c1bd-1fc6-4e2f-8720-0288ea44f433 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:33.409288 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7aefc95f-ca06-4365-9ecc-153f23cda139 req-98c7c1bd-1fc6-4e2f-8720-0288ea44f433 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1168811
Jun 01 11:11:33.482106 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b4b5e07f-baff-46c0-b6d1-2bff3794db62 req-458f20a7-ed2c-43c8-a783-58e3be04058b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0718865
Jun 01 11:11:33.486941 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7aefc95f-ca06-4365-9ecc-153f23cda139 req-be543aac-4c04-4281-b3d7-310c62d4b0f6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0628290
Jun 01 11:11:33.725921 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a4dcca-e785-42a7-81cf-e38606d1939e req-d3c93db8-c1d5-49e2-a301-186f9c0c8793 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:33.727360 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-67a4dcca-e785-42a7-81cf-e38606d1939e req-d3c93db8-c1d5-49e2-a301-186f9c0c8793 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 945 time: 0.1391852
Jun 01 11:11:33.735225 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ce8e8ae-f580-464d-96aa-b78bdd716801 req-756bc942-3422-4bf1-850c-e469a8e476d8 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:33.736562 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6ce8e8ae-f580-464d-96aa-b78bdd716801 req-756bc942-3422-4bf1-850c-e469a8e476d8 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1171920
Jun 01 11:11:33.807797 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-67a4dcca-e785-42a7-81cf-e38606d1939e req-6331958c-f6dc-44a1-b7c3-99593bed9bfa tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0702708
Jun 01 11:11:33.812718 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6ce8e8ae-f580-464d-96aa-b78bdd716801 req-4fd9c60d-b0fd-41c6-b587-afb4fcfaab34 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0596263
Jun 01 11:11:34.129422 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 33992) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:34.257128 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:34.271788 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:34.275728 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Usage tracker for resource:security_group_rule and tenant:e9d288d96fbf47c7aae04626658a4838 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:34.278904 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:34.284713 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:34.369737 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:34.375165 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:34.383976 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5bd116bf-299e-493e-8d3b-9fa6fc280258 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:34.422074 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=e9d288d96fbf47c7aae04626658a4838&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2915659
Jun 01 11:11:34.425031 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 34000) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:34.427226 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=535334a7-1f77-416c-8093-37ff870c6816,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:34.430301 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:34.488132 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-9e453695-ec5c-4f70-9121-37d8acc5ce6c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:34.517149 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-9e453695-ec5c-4f70-9121-37d8acc5ce6c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:34.584712 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-9e453695-ec5c-4f70-9121-37d8acc5ce6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:34.588976 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f8d940f5-2ad0-4d9f-8c44-389831bc3823 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:34.604240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e453695-ec5c-4f70-9121-37d8acc5ce6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=535334a7-1f77-416c-8093-37ff870c6816,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:34.609675 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-9e453695-ec5c-4f70-9121-37d8acc5ce6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:34.615942 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-9e453695-ec5c-4f70-9121-37d8acc5ce6c admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:34.617278 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-9e453695-ec5c-4f70-9121-37d8acc5ce6c admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/535334a7-1f77-416c-8093-37ff870c6816 HTTP/1.1" status: 204  len: 168 time: 0.1912684
Jun 01 11:11:34.791672 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6335440f-87a8-4888-a989-bbe73b8b0990 req-2c10dd71-7e20-41c7-88ae-4e57713e169a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:34.793932 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6335440f-87a8-4888-a989-bbe73b8b0990 req-2c10dd71-7e20-41c7-88ae-4e57713e169a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1483223
Jun 01 11:11:34.801550 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f42bb30b-c1a7-45a4-8d4c-4a2ea9886415 req-ea54a05a-2d00-4da0-a28b-879a2d4e86c2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:34.802982 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f42bb30b-c1a7-45a4-8d4c-4a2ea9886415 req-ea54a05a-2d00-4da0-a28b-879a2d4e86c2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1227772
Jun 01 11:11:34.880484 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6335440f-87a8-4888-a989-bbe73b8b0990 req-826fa1a6-4934-4bea-85d6-1fde51dae621 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0765092
Jun 01 11:11:34.888260 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f42bb30b-c1a7-45a4-8d4c-4a2ea9886415 req-9ed86b41-45c1-4825-8d5e-22a0d1fc6ca9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0681450
Jun 01 11:11:35.141823 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b154dbd6-087b-4170-8a2b-a9549a5e2902 req-b0668e75-6227-46ff-a29b-d46b1cf7c904 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:35.143294 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b154dbd6-087b-4170-8a2b-a9549a5e2902 req-b0668e75-6227-46ff-a29b-d46b1cf7c904 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 945 time: 0.1468229
Jun 01 11:11:35.151394 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c792e923-a1fb-4fa4-b1df-902e34dcfae2 req-7612f98e-3e02-491a-a56c-977fb41ed3c9 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:35.153469 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c792e923-a1fb-4fa4-b1df-902e34dcfae2 req-7612f98e-3e02-491a-a56c-977fb41ed3c9 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1229870
Jun 01 11:11:35.225192 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b154dbd6-087b-4170-8a2b-a9549a5e2902 req-58782cfc-3abb-48e3-bc9e-784e8f9f22e4 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0705054
Jun 01 11:11:35.236005 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c792e923-a1fb-4fa4-b1df-902e34dcfae2 req-b4ae4cf5-0e7d-4856-b10e-544b3f264354 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0664349
Jun 01 11:11:35.397224 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 34038) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:35.507460 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-908262529-network', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:35.512858 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:35.517146 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Usage tracker for resource:network and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:35.520174 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:35.526105 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:35.535870 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Made reservation on behalf of 5c3d0a0f97d246d5a7afac5ec8c4d43c for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:11:35.538105 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:35.550107 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:35.565604 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:35.569594 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Usage tracker for resource:security_group_rule and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:35.572536 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:35.580223 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:35.674857 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:35.680514 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:35.685423 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3792dabc-4d28-4e54-942b-0b0b9eeaa12b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:35.708461 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 680}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:11:35.739374 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:35.739738 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Added segment ecc23ea4-0a3f-4193-b594-468b9b7873c9 of type vlan for network 7356920a-571e-467c-9250-df782b9d8129
Jun 01 11:11:35.741003 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b439d80e-05e2-4757-aaae-a9fee5f6d9ee,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:35.748973 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:35.773536 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:35.806753 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:35.806995 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:35.807570 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:35.810861 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:35.912413 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.5140591
Jun 01 11:11:35.913434 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Pushing event updated for resources: {'Network': ['ID=7356920a-571e-467c-9250-df782b9d8129,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:35.915405 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34056) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:35.916664 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:35.927412 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 7356920a-571e-467c-9250-df782b9d8129 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:11:35.927882 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Request body: {'subnet': {'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-908262529-subnet', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'ip_version': 4}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:35.932720 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:35.936456 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Usage tracker for resource:subnet and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:35.939527 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:35.945515 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:35.957826 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Made reservation on behalf of 5c3d0a0f97d246d5a7afac5ec8c4d43c for: {'subnet': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:11:35.960759 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-11313286'] for subnet, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:36.160427 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59192d9-766e-4f0d-bf1b-e8fb47b463fb req-c008680d-fe30-43b7-925f-cade62b1e4e8 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:36.161994 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f59192d9-766e-4f0d-bf1b-e8fb47b463fb req-c008680d-fe30-43b7-925f-cade62b1e4e8 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1457558
Jun 01 11:11:36.172987 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd43ccea-00fd-4080-8779-0c1b5029f6bd req-7e16f6b2-f13b-4fea-ba5b-93c0c3158428 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:36.174526 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd43ccea-00fd-4080-8779-0c1b5029f6bd req-7e16f6b2-f13b-4fea-ba5b-93c0c3158428 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1224120
Jun 01 11:11:36.252862 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f59192d9-766e-4f0d-bf1b-e8fb47b463fb req-6f39731c-5348-4741-aae7-bbb7aa9119ff tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0773449
Jun 01 11:11:36.257665 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd43ccea-00fd-4080-8779-0c1b5029f6bd req-e05777c4-734f-4353-8e30-c2db242623da tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0646393
Jun 01 11:11:36.391402 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:11:36.407320 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10700502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-11313296'] for subnet, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:36.414012 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:36.482388 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c5b015bf-9c86-450a-8cbd-8892adfddfb6,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:36.482917 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b4c0270-6726-4afb-8065-5f943c5f65b8 req-7f78bcf7-de62-4422-ab22-31be51dc2e41 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:36.486403 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:36.495868 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2b4c0270-6726-4afb-8065-5f943c5f65b8 req-7f78bcf7-de62-4422-ab22-31be51dc2e41 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1097431
Jun 01 11:11:36.554602 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Checking segment: {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:36.554955 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Network hostable DHCP agents. Network: 7356920a-571e-467c-9250-df782b9d8129, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119240) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:11:36.564121 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2b4c0270-6726-4afb-8065-5f943c5f65b8 req-bd7e8fed-2363-458b-9bd4-6a66e4dda69d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0643268
Jun 01 11:11:36.582510 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Network 7356920a-571e-467c-9250-df782b9d8129 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119240) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:11:36.597912 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:36.598842 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 7356920a-571e-467c-9250-df782b9d8129) {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:36.608663 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:36.609245 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:36.616383 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-769d6607-26d1-431f-bbc3-2dd097bf17a9 None None] Network 7356920a-571e-467c-9250-df782b9d8129 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:11:36.637064 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 0.7190800
Jun 01 11:11:36.638670 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34072) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:36.642122 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '6c613458-8891-4e54-aa10-4a7743587916', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'port_id': '6c613458-8891-4e54-aa10-4a7743587916', 'mac_address': 'fa:16:3e:c8:58:1c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:11:36.647051 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:36.652043 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:36.657277 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Usage tracker for resource:router and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:36.661823 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:36.669303 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:36.680855 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:36.682232 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:36.701086 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:36.788495 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:36.829815 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 6c613458-8891-4e54-aa10-4a7743587916 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:11:36.830038 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-186f2d36-eb29-469c-a2b4-4e7be2d164f7 req-34c8a2d9-a472-44ab-a5f6-161bc0b3722e tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:36.831649 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-186f2d36-eb29-469c-a2b4-4e7be2d164f7 req-34c8a2d9-a472-44ab-a5f6-161bc0b3722e tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 945 time: 0.1873574
Jun 01 11:11:36.893790 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:36.908445 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:36.918166 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:36.959879 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-186f2d36-eb29-469c-a2b4-4e7be2d164f7 req-ecf91bb5-f70f-4419-a8f0-125fb304de06 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0958962
Jun 01 11:11:37.045656 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-7356920a-571e-467c-9250-df782b9d8129', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:11:37.046481 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.059549 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['6c613458-8891-4e54-aa10-4a7743587916'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:11:37.104789 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.114079 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=6']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:37.123315 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:37.346173 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Allocated IP 172.20.0.2 (7356920a-571e-467c-9250-df782b9d8129/c5b015bf-9c86-450a-8cbd-8892adfddfb6/c1678ffd-eeeb-49dd-802f-c62185c0fb7e) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:11:37.447567 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.484703 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.561017 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ce2dff-db42-4107-9bfc-f6ac8e7a345d req-7c78d9f7-7576-4f62-99e3-4a79dbd96c1d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:37.567890 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-84ce2dff-db42-4107-9bfc-f6ac8e7a345d req-7c78d9f7-7576-4f62-99e3-4a79dbd96c1d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 944 time: 0.1288540
Jun 01 11:11:37.577400 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fff432f-221d-463c-9c06-c0ce9126fe3b req-952f1e08-d139-4a82-90a2-53968d3c53d2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:37.578839 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6fff432f-221d-463c-9c06-c0ce9126fe3b req-952f1e08-d139-4a82-90a2-53968d3c53d2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1785238
Jun 01 11:11:37.593569 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.609854 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Transition to ACTIVE for port object c1678ffd-eeeb-49dd-802f-c62185c0fb7e will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:37.638264 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Transition to ACTIVE for port object c1678ffd-eeeb-49dd-802f-c62185c0fb7e will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:37.644079 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Allocated IP 172.27.3.84 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/f8b28fb3-0268-438a-bb44-551f800a3a7b) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:11:37.646029 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.650849 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:37.674581 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-84ce2dff-db42-4107-9bfc-f6ac8e7a345d req-15b80ee3-b11e-442b-8d74-9f571e4681c9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1056399
Jun 01 11:11:37.691892 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6fff432f-221d-463c-9c06-c0ce9126fe3b req-1325ab70-ac17-4660-aa2b-a8078763bf96 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0994835
Jun 01 11:11:37.752955 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Network 7356920a-571e-467c-9250-df782b9d8129 is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:37.756289 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:37.760356 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:11:37.766506 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Pushing event updated for resources: {'Port': ['ID=c1678ffd-eeeb-49dd-802f-c62185c0fb7e,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:37.770674 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:37.856990 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.894070 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Attempting to bind port c1678ffd-eeeb-49dd-802f-c62185c0fb7e on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:11:37.894687 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Attempting to bind port c1678ffd-eeeb-49dd-802f-c62185c0fb7e by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:11:37.894959 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Attempting to bind port c1678ffd-eeeb-49dd-802f-c62185c0fb7e on network 7356920a-571e-467c-9250-df782b9d8129 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:37.897548 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c09b71-390a-480a-989a-12644171dddb req-4924edad-5370-48df-bd24-b0c014f3033b tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:37.897762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.899073 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-45c09b71-390a-480a-989a-12644171dddb req-4924edad-5370-48df-bd24-b0c014f3033b tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1003301
Jun 01 11:11:37.902748 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 11, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:11:37.904205 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Checking segment: {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:37.904671 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.904791 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-232713d3-b209-4159-b2aa-c3a8e1b6bbc2 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:37.905354 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Bound using segment: {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:11:37.905972 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Bound port: c1678ffd-eeeb-49dd-802f-c62185c0fb7e, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:11:37.906524 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:37.976243 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-45c09b71-390a-480a-989a-12644171dddb req-2e582bb7-72ec-4559-a053-b00eeee2d45c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0688622
Jun 01 11:11:38.038271 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:38.058178 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:38.068895 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:11:38.078619 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] For port c1678ffd-eeeb-49dd-802f-c62185c0fb7e, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:11:38.084302 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] For port c1678ffd-eeeb-49dd-802f-c62185c0fb7e, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=c1678ffd-eeeb-49dd-802f-c62185c0fb7e,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:11:38.094355 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:38.105111 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:38.129273 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Pushing event updated for resources: {'Port': ['ID=f8b28fb3-0268-438a-bb44-551f800a3a7b,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:38.137448 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:38.170144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b803cfc-a538-403e-bb1b-8a0ef2b524b7 req-514a773d-ad71-4089-8c1e-376bf6dd3b5f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:38.171935 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8b803cfc-a538-403e-bb1b-8a0ef2b524b7 req-514a773d-ad71-4089-8c1e-376bf6dd3b5f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1449480
Jun 01 11:11:38.237623 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Pushing event updated for resources: {'Port': ['ID=c1678ffd-eeeb-49dd-802f-c62185c0fb7e,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:38.240962 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:38.268565 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8b803cfc-a538-403e-bb1b-8a0ef2b524b7 req-6cdc924a-606d-44e0-9b3f-045075837c3f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0587540
Jun 01 11:11:38.299390 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc70f061-7065-407e-bae1-0081649c0d35 req-72bd6cf6-3d62-4b8e-a2c1-eacab086b9f4 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:38.304157 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cc70f061-7065-407e-bae1-0081649c0d35 req-72bd6cf6-3d62-4b8e-a2c1-eacab086b9f4 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 945 time: 0.1428344
Jun 01 11:11:38.353985 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cc70f061-7065-407e-bae1-0081649c0d35 req-12a6295b-fffe-423f-bc1b-d374b5fc6e5a tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/security-groups?id=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464997
Jun 01 11:11:38.406976 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:38.551696 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 6c613458-8891-4e54-aa10-4a7743587916 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:38.552091 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:38.558109 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-2b7f8075-2e4d-40f5-888f-12aa4781b869 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:38.560344 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-2b7f8075-2e4d-40f5-888f-12aa4781b869 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 1098 time: 0.3126283
Jun 01 11:11:38.565517 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-a125956f-6107-46ee-9042-287fb10d75dc tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:38.567279 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-a125956f-6107-46ee-9042-287fb10d75dc tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.79 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 945 time: 0.1455712
Jun 01 11:11:38.696128 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:38.730930 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c613458-8891-4e54-aa10-4a7743587916'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:38.733366 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36b8520b-e6e0-4db7-8eb3-d3f0849bf243" -d '{"events": [{"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-plugged", "status": "completed", "tag": "6c613458-8891-4e54-aa10-4a7743587916"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:38.753664 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Deleting port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:11:38.759217 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:38.759476 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:38.769212 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:38.771439 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:38.864279 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb7d7e3b-18f7-497e-a8a1-32b2553cbffb x-openstack-request-id: req-eb7d7e3b-18f7-497e-a8a1-32b2553cbffb {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:38.864951 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-plugged", "status": "completed", "tag": "6c613458-8891-4e54-aa10-4a7743587916", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:38.865223 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-eb7d7e3b-18f7-497e-a8a1-32b2553cbffb {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:38.865625 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c613458-8891-4e54-aa10-4a7743587916', 'code': 200}
Jun 01 11:11:38.866261 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=7']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:38.872368 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:38.979123 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:39.013301 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] For port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,segment=NetworkSegment(50169f53-532c-4126-a49b-bd813455458e),segment_id=50169f53-532c-4126-a49b-bd813455458e)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:39.013936 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:39.053691 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-b855e46c-d05a-4637-86fe-30bb6cdc3825 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:39.055158 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-b855e46c-d05a-4637-86fe-30bb6cdc3825 service neutron] 10.222.0.79 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 911 time: 0.4860930
Jun 01 11:11:39.156961 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Calling delete_port for 1f3a7c73-8f1f-4696-9d4b-578f9092a68b owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:11:39.255822 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-f152ebf8-0981-476b-adab-4d448f659abf service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263 HTTP/1.1" status: 200  len: 1000 time: 0.1882963
Jun 01 11:11:39.287573 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116a5072-2d46-40b6-88f4-1735bec263b6 req-a80a1d70-f742-413e-8811-8feaa36f40b6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:39.289452 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-116a5072-2d46-40b6-88f4-1735bec263b6 req-a80a1d70-f742-413e-8811-8feaa36f40b6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.4235563
Jun 01 11:11:39.344074 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d9e72a-3400-426a-a3d5-aa4887e80244 req-18e1ed8f-05b1-4305-8ee7-9f7c567721dc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:39.345577 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e5d9e72a-3400-426a-a3d5-aa4887e80244 req-18e1ed8f-05b1-4305-8ee7-9f7c567721dc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.2003083
Jun 01 11:11:39.354753 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ceba625c-2003-4c06-9956-86a06a87d57d None None] Network 7356920a-571e-467c-9250-df782b9d8129 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:11:39.392276 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-116a5072-2d46-40b6-88f4-1735bec263b6 req-26dc6e2a-990e-4a5f-ad92-9012852df830 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0922146
Jun 01 11:11:39.471887 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-05fd415d-a984-49f0-b750-875ea84f5681 None None] Provisioning for port c1678ffd-eeeb-49dd-802f-c62185c0fb7e completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:39.487887 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-0c930f53-86d7-4933-ba97-70eb5da1c3a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:39.491628 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-0c930f53-86d7-4933-ba97-70eb5da1c3a7 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=08c4a15d-0d06-4d4b-909f-10ac28c5c16c HTTP/1.1" status: 200  len: 849 time: 0.2204928
Jun 01 11:11:39.518903 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e5d9e72a-3400-426a-a3d5-aa4887e80244 req-329fb53b-17a3-4f8b-8f85-12e605b8135e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1644802
Jun 01 11:11:39.519485 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:39.526710 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0d0f7082-26e2-44ed-ae6d-39b8f866d620 tempest-DeleteServersTestJSON-1849583402 tempest-DeleteServersTestJSON-1849583402-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:39.541318 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['1f3a7c73-8f1f-4696-9d4b-578f9092a68b'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:11:39.580044 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:39.622757 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Pushing event deleted for resources: {'Port': ['ID=1f3a7c73-8f1f-4696-9d4b-578f9092a68b,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:39.630538 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:39.753050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-6bd45d0a-ed4c-4e50-bec9-e02eb258a54d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:39.754688 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-6bd45d0a-ed4c-4e50-bec9-e02eb258a54d service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=418faffe-faca-4025-ab0f-56771435263e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2543991
Jun 01 11:11:39.878637 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-987d1097-5939-4706-9fad-8572114782df req-3564a458-9dc0-4c5a-b4d1-0f1d001a2aa8 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.74 "GET /v2.0/ports?device_id=c040b44e-1b79-49b4-a1af-cba37e481a47 HTTP/1.1" status: 200  len: 210 time: 0.1991389
Jun 01 11:11:39.891148 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] No DVR routers for this DVR port 1f3a7c73-8f1f-4696-9d4b-578f9092a68b on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:11:39.894266 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:39.911616 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c040b44e-1b79-49b4-a1af-cba37e481a47', 'name': 'network-vif-deleted', 'tag': '1f3a7c73-8f1f-4696-9d4b-578f9092a68b'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:11:39.913869 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be377420-bea2-46a9-84aa-9dd65fe72050" -d '{"events": [{"server_uuid": "c040b44e-1b79-49b4-a1af-cba37e481a47", "name": "network-vif-deleted", "tag": "1f3a7c73-8f1f-4696-9d4b-578f9092a68b"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:11:39.916325 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-740f5b45-e5b2-47d5-a76b-77d34d110a28 req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] 10.222.0.79 "DELETE /v2.0/ports/1f3a7c73-8f1f-4696-9d4b-578f9092a68b HTTP/1.1" status: 204  len: 173 time: 1.3311491
Jun 01 11:11:39.951321 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efefe0e7-5458-4078-b12b-6059798c1d50 req-7eea3ce0-5bcf-47fb-bd34-79e5bd0ed2b6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:39.953127 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-efefe0e7-5458-4078-b12b-6059798c1d50 req-7eea3ce0-5bcf-47fb-bd34-79e5bd0ed2b6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.3802564
Jun 01 11:11:39.976395 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:11:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad3a3ee6-76cc-47b4-b3dc-979d60554323 x-openstack-request-id: req-ad3a3ee6-76cc-47b4-b3dc-979d60554323 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:11:39.976707 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c040b44e-1b79-49b4-a1af-cba37e481a47", "name": "network-vif-deleted", "tag": "1f3a7c73-8f1f-4696-9d4b-578f9092a68b", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:11:39.976977 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-ad3a3ee6-76cc-47b4-b3dc-979d60554323 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:11:39.977376 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c040b44e-1b79-49b4-a1af-cba37e481a47', 'name': 'network-vif-deleted', 'tag': '1f3a7c73-8f1f-4696-9d4b-578f9092a68b', 'status': 'completed', 'code': 200}
Jun 01 11:11:39.993801 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-e0f67de9-58dd-46d4-8def-2349af3fbe38 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2305400
Jun 01 11:11:39.999474 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119240) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:11:40.008987 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-efefe0e7-5458-4078-b12b-6059798c1d50 req-e7d6f339-beae-4121-bf8e-6afba4a9de76 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0474699
Jun 01 11:11:40.352392 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device c1678ffd-eeeb-49dd-802f-c62185c0fb7e up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:40.414783 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-966b7206-df95-4ce8-b962-f4d9857c5556 req-5b5db76e-c637-45ab-a45a-23b2cf398e4e service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4110312
Jun 01 11:11:40.425578 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:11:40.443957 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Sync routers for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:11:40.455085 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port c1678ffd-eeeb-49dd-802f-c62185c0fb7e completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:40.459838 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:11:40.461591 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57991696d0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:11:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:40.462534 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port c1678ffd-eeeb-49dd-802f-c62185c0fb7e triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:40.463113 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:40.486412 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:40.491268 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 34118) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:40.498605 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 925 time: 3.8586581
Jun 01 11:11:40.601294 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:40.637137 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port c1678ffd-eeeb-49dd-802f-c62185c0fb7e, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=c1678ffd-eeeb-49dd-802f-c62185c0fb7e,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:40.642720 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:40.645320 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:40.736967 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=c1678ffd-eeeb-49dd-802f-c62185c0fb7e,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:40.738110 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:11:40.740454 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:41.004818 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2773290-ecbe-4a2f-8044-e36ecc79216e req-e6fd23b1-4c30-4faa-bce8-83356a2b5a47 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:41.006334 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e2773290-ecbe-4a2f-8044-e36ecc79216e req-e6fd23b1-4c30-4faa-bce8-83356a2b5a47 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2919912
Jun 01 11:11:41.044794 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57991696d0>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:38Z', 'revision_number': 3, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:41.049229 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Checking router: a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:11:41.049829 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Updating router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 port f8b28fb3-0268-438a-bb44-551f800a3a7b binding host dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:11:41.055947 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561bebdc-165a-46a4-860e-7aae559bdebb req-1f7d3d54-6cda-4f16-a733-82d9b4ec282f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:41.057428 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-561bebdc-165a-46a4-860e-7aae559bdebb req-1f7d3d54-6cda-4f16-a733-82d9b4ec282f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.3023403
Jun 01 11:11:41.105584 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e2773290-ecbe-4a2f-8044-e36ecc79216e req-a471f2eb-6b14-4f53-9a81-1643cc9a0810 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0879855
Jun 01 11:11:41.111011 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:41.246167 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-561bebdc-165a-46a4-860e-7aae559bdebb req-04ba2702-bc18-4d3d-9f81-08e40f7376cd tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1748581
Jun 01 11:11:41.495357 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2006264f-8257-4aeb-b039-784935b79b9b req-b7c98ec1-72fe-4797-8b02-10c999f84e27 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:41.497762 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2006264f-8257-4aeb-b039-784935b79b9b req-b7c98ec1-72fe-4797-8b02-10c999f84e27 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1780243
Jun 01 11:11:41.526035 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Notify callbacks [] for port, precommit_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:41.542834 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.provisioning_blocks [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Transition to ACTIVE for port object f8b28fb3-0268-438a-bb44-551f800a3a7b will not be triggered until provisioned by entity L2. {{(pid=119243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:41.551428 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:41.556995 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:41.599651 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2006264f-8257-4aeb-b039-784935b79b9b req-4cb5c98d-095e-4503-80be-3b2f53459fec tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0944192
Jun 01 11:11:41.653442 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Pushing event updated for resources: {'Port': ['ID=f8b28fb3-0268-438a-bb44-551f800a3a7b,revision_number=2']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:41.658220 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Attempting to bind port f8b28fb3-0268-438a-bb44-551f800a3a7b on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:11:41.658657 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Attempting to bind port f8b28fb3-0268-438a-bb44-551f800a3a7b by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:11:41.659091 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Attempting to bind port f8b28fb3-0268-438a-bb44-551f800a3a7b on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:41.660022 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:41.670606 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 11, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:11:41.671058 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:41.671533 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:41.671996 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:11:41.673626 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Bound port: f8b28fb3-0268-438a-bb44-551f800a3a7b, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:11:41.674666 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:41.705229 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.705917 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.706252 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.706632 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.706953 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.707399 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.707741 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.708056 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.708386 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.708701 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.709011 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.709319 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:41.717114 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:41.768087 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] For port f8b28fb3-0268-438a-bb44-551f800a3a7b, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:11:41.771549 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] For port f8b28fb3-0268-438a-bb44-551f800a3a7b, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f8b28fb3-0268-438a-bb44-551f800a3a7b,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:11:41.776311 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:41.780654 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-b7c1ba68-7995-4ad5-a513-1357c267b22d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:41.859628 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:11:41.859628 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57991696d0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:11:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:41.909100 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Allocated IP 172.20.0.1 (7356920a-571e-467c-9250-df782b9d8129/c5b015bf-9c86-450a-8cbd-8892adfddfb6/e95624ae-5876-4f15-ad18-6a0cf9360081) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:11:41.944194 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Pushing event updated for resources: {'Port': ['ID=f8b28fb3-0268-438a-bb44-551f800a3a7b,revision_number=3']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:41.949017 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-d362ba3a-2d13-42a3-a726-06c876896a6e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:42.048646 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:11:42.084955 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:42.106355 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Transition to ACTIVE for port object e95624ae-5876-4f15-ad18-6a0cf9360081 will not be triggered until provisioned by entity DHCP. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:42.137245 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:42.145128 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:42.345673 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device c1678ffd-eeeb-49dd-802f-c62185c0fb7e up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:42.420790 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 1f3a7c73-8f1f-4696-9d4b-578f9092a68b no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:11:42.427297 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Network 7356920a-571e-467c-9250-df782b9d8129 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:42.464138 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:42.466463 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 1f3a7c73-8f1f-4696-9d4b-578f9092a68b {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:11:42.467025 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 1f3a7c73-8f1f-4696-9d4b-578f9092a68b not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:11:42.485101 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:11:42.504457 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57991696d0>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:38Z', 'revision_number': 3, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:42.509814 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port c1678ffd-eeeb-49dd-802f-c62185c0fb7e triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:42.510327 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:42.511828 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5767d67d-edd4-4914-9483-34fcdc6b6025 None None] The sync data for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi is: [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:38Z', 'revision_number': 3, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:11:42.549183 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Pushing event updated for resources: {'Port': ['ID=e95624ae-5876-4f15-ad18-6a0cf9360081,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:42.573340 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.418s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:42.601845 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:42.755856 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a857dbd8-222c-4fd3-98d0-5c87147e4ee6 req-6454c129-e420-4712-9b49-2544c7fe23a6 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:42.757481 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a857dbd8-222c-4fd3-98d0-5c87147e4ee6 req-6454c129-e420-4712-9b49-2544c7fe23a6 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.3702009
Jun 01 11:11:42.774754 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f53f559-94b5-4640-b414-d930f05334bf req-6f556b0c-cd24-4860-8e91-75458d2cd23f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:42.776464 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2f53f559-94b5-4640-b414-d930f05334bf req-6f556b0c-cd24-4860-8e91-75458d2cd23f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.4011681
Jun 01 11:11:42.895792 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-e24990e9-3fa1-4f6c-93a8-069fd35f0a3c None None] Provisioning for port e95624ae-5876-4f15-ad18-6a0cf9360081 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:42.900822 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-e24990e9-3fa1-4f6c-93a8-069fd35f0a3c None None] Provisioning complete for port e95624ae-5876-4f15-ad18-6a0cf9360081 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:42.901205 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e24990e9-3fa1-4f6c-93a8-069fd35f0a3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:42.902073 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a857dbd8-222c-4fd3-98d0-5c87147e4ee6 req-dcfc8f5f-b559-4fe6-a31a-fb8656e8e05c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1372180
Jun 01 11:11:42.941161 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2f53f559-94b5-4640-b414-d930f05334bf req-fe1d5fe9-9999-43b4-9da7-19332539a096 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1509326
Jun 01 11:11:42.972421 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:42.993766 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-e24990e9-3fa1-4f6c-93a8-069fd35f0a3c None None] Port e95624ae-5876-4f15-ad18-6a0cf9360081 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:11:43.264619 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8edbeae-1798-4d24-9080-b42a582c7deb req-27faac4e-256b-4a74-8ea9-cc738159e9ce tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:43.266397 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e8edbeae-1798-4d24-9080-b42a582c7deb req-27faac4e-256b-4a74-8ea9-cc738159e9ce tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.2117188
Jun 01 11:11:43.325117 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:43.336809 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e8edbeae-1798-4d24-9080-b42a582c7deb req-82b72a2a-d3b7-4551-b0db-78fdb888ce9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0640273
Jun 01 11:11:43.337431 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:43.363855 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fd1d500a-d72a-4524-85d9-ef1760f44ddb tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:43.452563 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:43.456194 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Pushing event updated for resources: {'Port': ['ID=e95624ae-5876-4f15-ad18-6a0cf9360081,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:43.459474 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:43.596103 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Network 7356920a-571e-467c-9250-df782b9d8129 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:43.597084 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:43.800280 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:11:43.817899 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-d8905b7d-9f29-4ef9-8b32-4a7669c28759 None None] Provisioning complete for port e95624ae-5876-4f15-ad18-6a0cf9360081 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:43.818549 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-d8905b7d-9f29-4ef9-8b32-4a7669c28759 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:43.874753 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-d8905b7d-9f29-4ef9-8b32-4a7669c28759 None None] Port e95624ae-5876-4f15-ad18-6a0cf9360081 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:11:43.993966 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:11:44.003756 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] 10.222.0.74 "PUT /v2.0/routers/a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.5112224
Jun 01 11:11:44.179071 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3516e471-86af-43cc-9e2a-857ba7ae8ca4 req-c52ddec5-e504-4ae5-90a8-638f68c46920 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:44.182805 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3516e471-86af-43cc-9e2a-857ba7ae8ca4 req-c52ddec5-e504-4ae5-90a8-638f68c46920 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1550257
Jun 01 11:11:44.327391 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e2a2830-6b78-4487-9947-c56ff280ada4 req-349047d4-7cee-44f4-a3d3-98153eefbfea tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:44.328854 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e2a2830-6b78-4487-9947-c56ff280ada4 req-349047d4-7cee-44f4-a3d3-98153eefbfea tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2367702
Jun 01 11:11:44.333332 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f8b28fb3-0268-438a-bb44-551f800a3a7b up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:44.361440 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3516e471-86af-43cc-9e2a-857ba7ae8ca4 req-e5c9d204-df12-4320-9f49-1fea6f693f0f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1697295
Jun 01 11:11:44.391286 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Sync routers for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:11:44.416876 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e2a2830-6b78-4487-9947-c56ff280ada4 req-ba42db3c-88ec-4d4b-8039-b79105c48ea6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0615237
Jun 01 11:11:44.432613 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:11:44.433659 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57985981c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:11:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:44.602093 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port f8b28fb3-0268-438a-bb44-551f800a3a7b completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:44.629407 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 34198) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:44.635878 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2125915688-network', 'tenant_id': '65f10d0e259c4764a0a20338456489de'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:44.640931 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:44.644861 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Usage tracker for resource:network and tenant:65f10d0e259c4764a0a20338456489de is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:44.647993 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:44.651209 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port f8b28fb3-0268-438a-bb44-551f800a3a7b triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:44.651580 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:44.654507 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:44.665530 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Made reservation on behalf of 65f10d0e259c4764a0a20338456489de for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:11:44.668553 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:44.680470 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:44.700178 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:44.704529 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Usage tracker for resource:security_group_rule and tenant:65f10d0e259c4764a0a20338456489de is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:44.708007 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:44.713700 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:44.731193 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:11:44.812623 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:44.818408 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:44.822948 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a7c95fd9-369d-4bf0-bdef-3d366cdc4303 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:44.850758 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 659}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:11:44.864225 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1dca14a3-a373-46a8-9ac7-a18792ff81d0,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:44.867727 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:44.871376 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:44.871753 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Added segment 8323217a-f39d-4f1e-8f5b-826579119c97 of type vlan for network c783f943-bfd7-40b4-abd5-264b3d0bdef5
Jun 01 11:11:44.904977 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:44.937793 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:44.939720 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:44.940425 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:44.945481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:44.987249 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.027417 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port f8b28fb3-0268-438a-bb44-551f800a3a7b, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f8b28fb3-0268-438a-bb44-551f800a3a7b,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:45.041365 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.046081 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:45.047238 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Pushing event updated for resources: {'Network': ['ID=c783f943-bfd7-40b4-abd5-264b3d0bdef5,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:45.050079 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:45.051600 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.4210832
Jun 01 11:11:45.054505 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34204) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:45.060767 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Request body: {'subnet': {'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2125915688-subnet', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'ip_version': 4}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:45.065813 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:45.069738 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Usage tracker for resource:subnet and tenant:65f10d0e259c4764a0a20338456489de is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:45.073540 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:45.080072 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:45.087936 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network c783f943-bfd7-40b4-abd5-264b3d0bdef5 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:11:45.092264 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Made reservation on behalf of 65f10d0e259c4764a0a20338456489de for: {'subnet': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:11:45.094546 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-11313286'] for subnet, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.266343 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=f8b28fb3-0268-438a-bb44-551f800a3a7b,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:45.272264 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:45.299059 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57985981c0>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:42Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'e95624ae-5876-4f15-ad18-6a0cf9360081', 'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'mac_address': 'fa:16:3e:79:34:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_interface', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:41Z', 'updated_at': '2021-06-01T11:11:43Z', 'revision_number': 2, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'subnets': [{'id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:45.303145 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Checking router: a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:11:45.303506 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Updating router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 port e95624ae-5876-4f15-ad18-6a0cf9360081 binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:11:45.358196 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.522758 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10700502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-11313296'] for subnet, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.530849 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-80c00070-4acc-468f-9f4c-65928fcb2f68 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:45.607991 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Pushing event updated for resources: {'Subnet': ['ID=60e72189-c1a7-443f-8dca-6646b19c0101,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:45.611422 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:45.617267 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Checking segment: {'id': '8323217a-f39d-4f1e-8f5b-826579119c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:45.617538 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Network hostable DHCP agents. Network: c783f943-bfd7-40b4-abd5-264b3d0bdef5, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119240) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:11:45.643554 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Network c783f943-bfd7-40b4-abd5-264b3d0bdef5 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119240) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:11:45.654915 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, c783f943-bfd7-40b4-abd5-264b3d0bdef5) {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:45.666414 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:45.668620 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.674442 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-137577b8-7655-415c-9406-6134c0c64ffd None None] Network c783f943-bfd7-40b4-abd5-264b3d0bdef5 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:11:45.694554 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 34214) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:45.695135 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.6391246
Jun 01 11:11:45.709796 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:11:45.719482 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:11:45.728836 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Usage tracker for resource:router and tenant:65f10d0e259c4764a0a20338456489de is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:11:45.732711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:11:45.742359 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcc1473-ed38-4d19-94fc-97495e88ca2b req-4b2040e8-36c3-4792-87df-508bcfd38c76 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:45.743877 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bcc1473-ed38-4d19-94fc-97495e88ca2b req-4b2040e8-36c3-4792-87df-508bcfd38c76 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1519790
Jun 01 11:11:45.751956 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:11:45.776222 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aecd1a38-8ddd-49de-bf8f-9eadbc44f533 req-84b6dd89-1ac6-4ce4-a20b-08bdd3d5512a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:45.777639 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-aecd1a38-8ddd-49de-bf8f-9eadbc44f533 req-84b6dd89-1ac6-4ce4-a20b-08bdd3d5512a tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.2490592
Jun 01 11:11:45.815286 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.816324 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.844001 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bcc1473-ed38-4d19-94fc-97495e88ca2b req-534d907e-414a-444e-944b-ca32bee90423 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0932765
Jun 01 11:11:45.857157 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-aecd1a38-8ddd-49de-bf8f-9eadbc44f533 req-ccc477f6-fa7f-47de-b06e-f4e2b7f606cc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0713148
Jun 01 11:11:45.860426 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.868847 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.894140 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Transition to ACTIVE for port object e95624ae-5876-4f15-ad18-6a0cf9360081 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:45.903671 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:45.908770 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:46.091333 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27928898-ebc2-4603-bea1-9d50c31dcd9c None None] Pushing event updated for resources: {'Port': ['ID=e95624ae-5876-4f15-ad18-6a0cf9360081,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:46.097557 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-27928898-ebc2-4603-bea1-9d50c31dcd9c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:46.152435 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.242720 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-c783f943-bfd7-40b4-abd5-264b3d0bdef5', 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'fixed_ips': [{'subnet_id': '60e72189-c1a7-443f-8dca-6646b19c0101'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:11:46.243569 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.288157 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Attempting to bind port e95624ae-5876-4f15-ad18-6a0cf9360081 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:11:46.288521 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Attempting to bind port e95624ae-5876-4f15-ad18-6a0cf9360081 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:11:46.288898 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Attempting to bind port e95624ae-5876-4f15-ad18-6a0cf9360081 on network 7356920a-571e-467c-9250-df782b9d8129 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:46.335609 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f8b28fb3-0268-438a-bb44-551f800a3a7b up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:46.369132 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 11, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:11:46.369514 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Checking segment: {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:46.369920 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.370323 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Bound using segment: {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:11:46.371363 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Bound port: e95624ae-5876-4f15-ad18-6a0cf9360081, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:11:46.371798 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.485077 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.517503 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.578782 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] For port e95624ae-5876-4f15-ad18-6a0cf9360081, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:11:46.599253 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] For port e95624ae-5876-4f15-ad18-6a0cf9360081, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=e95624ae-5876-4f15-ad18-6a0cf9360081,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:11:46.603630 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.604321 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port f8b28fb3-0268-438a-bb44-551f800a3a7b triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:46.604737 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.629432 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Allocated IP 172.20.0.2 (c783f943-bfd7-40b4-abd5-264b3d0bdef5/60e72189-c1a7-443f-8dca-6646b19c0101/2ea40bcb-0c35-4e50-8ff2-1a55222eba02) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:11:46.646617 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.662368 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a49f71c6-702f-471a-b111-1dba4d7f37a0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:46.672762 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Allocated IP 172.27.3.91 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/cf997a22-dc15-4e60-8145-58a514804936) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:11:46.848343 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27928898-ebc2-4603-bea1-9d50c31dcd9c None None] Pushing event updated for resources: {'Port': ['ID=e95624ae-5876-4f15-ad18-6a0cf9360081,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:46.848612 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.853538 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:11:46.854095 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57985981c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:11:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:46.886003 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:46.892767 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cdad0d5c-492d-4653-9c93-b88e976ef676 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:46.972954 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-27928898-ebc2-4603-bea1-9d50c31dcd9c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:47.149220 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:47.156893 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:47.159315 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:11:47.218969 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:47.224793 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Pushing event updated for resources: {'Port': ['ID=cf997a22-dc15-4e60-8145-58a514804936,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:47.231862 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.339s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:47.237287 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Transition to ACTIVE for port object 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:47.268781 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:11:47.312253 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Transition to ACTIVE for port object 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:47.329010 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:47.335250 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:47.403251 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7baadacb-04f1-4988-8ad0-54303dae6f18 req-085dbb6d-6280-4d57-98c5-65789506033b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:47.404687 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7baadacb-04f1-4988-8ad0-54303dae6f18 req-085dbb6d-6280-4d57-98c5-65789506033b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.3718190
Jun 01 11:11:47.463717 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Network c783f943-bfd7-40b4-abd5-264b3d0bdef5 is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:47.467428 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:47.485375 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:11:47.488970 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5faefea-d51a-42ea-bfaf-2769094dbb8c req-1789114e-bf2a-48ee-919c-7470356eaa6c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:47.490267 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5faefea-d51a-42ea-bfaf-2769094dbb8c req-1789114e-bf2a-48ee-919c-7470356eaa6c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.4011164
Jun 01 11:11:47.501391 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Pushing event updated for resources: {'Port': ['ID=2ea40bcb-0c35-4e50-8ff2-1a55222eba02,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:47.539301 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7baadacb-04f1-4988-8ad0-54303dae6f18 req-10c29f40-377b-4b0a-b499-7763756db258 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0994635
Jun 01 11:11:47.575538 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:47.640159 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5faefea-d51a-42ea-bfaf-2769094dbb8c req-080077d6-4f20-472e-b329-90263fce3768 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1331482
Jun 01 11:11:47.671310 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Attempting to bind port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:11:47.671826 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Attempting to bind port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '8323217a-f39d-4f1e-8f5b-826579119c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:11:47.672292 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Attempting to bind port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 on network c783f943-bfd7-40b4-abd5-264b3d0bdef5 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:47.700975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 11, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:11:47.700975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Checking segment: {'id': '8323217a-f39d-4f1e-8f5b-826579119c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:47.700975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:47.700975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Bound using segment: {'id': '8323217a-f39d-4f1e-8f5b-826579119c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:11:47.700975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Bound port: 2ea40bcb-0c35-4e50-8ff2-1a55222eba02, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8323217a-f39d-4f1e-8f5b-826579119c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:11:47.700975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:47.748116 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:47.878382 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] For port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:11:47.881936 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] For port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=2ea40bcb-0c35-4e50-8ff2-1a55222eba02,segment=NetworkSegment(8323217a-f39d-4f1e-8f5b-826579119c97),segment_id=8323217a-f39d-4f1e-8f5b-826579119c97)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:11:47.888595 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57985981c0>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:42Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'e95624ae-5876-4f15-ad18-6a0cf9360081', 'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'mac_address': 'fa:16:3e:79:34:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_interface', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:41Z', 'updated_at': '2021-06-01T11:11:46Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'subnets': [{'id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:47.892175 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:47.896872 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:47.931205 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7dd1281-9acd-4b82-9331-0d7b44e0d627 None None] The sync data for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi is: [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:42Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'e95624ae-5876-4f15-ad18-6a0cf9360081', 'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'mac_address': 'fa:16:3e:79:34:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_interface', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:41Z', 'updated_at': '2021-06-01T11:11:46Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'subnets': [{'id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:11:47.997800 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Pushing event updated for resources: {'Port': ['ID=2ea40bcb-0c35-4e50-8ff2-1a55222eba02,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:48.000917 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:48.129172 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:48.416166 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device e95624ae-5876-4f15-ad18-6a0cf9360081 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:48.430535 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Router fa48cfa6-fa67-479e-86c6-8eea862fb754 is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119241) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:11:48.491238 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port e95624ae-5876-4f15-ad18-6a0cf9360081 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:48.499988 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port e95624ae-5876-4f15-ad18-6a0cf9360081 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:48.500536 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:48.656874 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:48.713123 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port e95624ae-5876-4f15-ad18-6a0cf9360081, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=e95624ae-5876-4f15-ad18-6a0cf9360081,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:48.721143 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:48.722083 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:48.761107 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:48.867787 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=e95624ae-5876-4f15-ad18-6a0cf9360081,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:48.872332 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:48.933736 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:48.947690 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:11:48.958298 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Sync routers for ids ['fa48cfa6-fa67-479e-86c6-8eea862fb754'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:11:48.968786 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Routers {'fa48cfa6-fa67-479e-86c6-8eea862fb754'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:11:48.969420 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57984b14c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:11:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['fa48cfa6-fa67-479e-86c6-8eea862fb754'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:48.996262 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-612f012b-0bf7-4017-9ca6-d9bbfcd5d7f5 req-673a0168-cdce-4582-944b-65e0537dbd4e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:48.997902 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-612f012b-0bf7-4017-9ca6-d9bbfcd5d7f5 req-673a0168-cdce-4582-944b-65e0537dbd4e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2616639
Jun 01 11:11:49.034008 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Notify callbacks [] for router, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:49.038558 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 3.3372569
Jun 01 11:11:49.038852 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34238) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:11:49.081001 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae2fe3a-235c-41dc-aada-8f5072d70f3e req-7f73f673-7a3c-41ad-9038-1786e4740674 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:49.082661 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3ae2fe3a-235c-41dc-aada-8f5072d70f3e req-7f73f673-7a3c-41ad-9038-1786e4740674 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.2488790
Jun 01 11:11:49.088745 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-612f012b-0bf7-4017-9ca6-d9bbfcd5d7f5 req-1a7a3050-4742-4110-bb05-f76a4b4c7ac4 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0842872
Jun 01 11:11:49.158885 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3ae2fe3a-235c-41dc-aada-8f5072d70f3e req-3a9f4be6-913c-42c0-8be9-99cc63813fd1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0691364
Jun 01 11:11:49.234206 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Set router fa48cfa6-fa67-479e-86c6-8eea862fb754 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:11:49.236507 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-521c18a8-9512-4166-a31b-0593bcca8a7f None None] Network c783f943-bfd7-40b4-abd5-264b3d0bdef5 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:11:49.399184 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-c7ec9ea8-7dd7-4e93-8fde-2e3062e76779 None None] Provisioning for port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:49.410375 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-c7ec9ea8-7dd7-4e93-8fde-2e3062e76779 None None] Provisioning complete for port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:49.410755 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c7ec9ea8-7dd7-4e93-8fde-2e3062e76779 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:49.584384 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57984b14c0>, [{'id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91'}], 'enable_snat': True}, 'gw_port_id': 'cf997a22-dc15-4e60-8145-58a514804936', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:45Z', 'updated_at': '2021-06-01T11:11:47Z', 'revision_number': 3, 'project_id': '65f10d0e259c4764a0a20338456489de', 'gw_port': {'id': 'cf997a22-dc15-4e60-8145-58a514804936', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:ba:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 406, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:46Z', 'updated_at': '2021-06-01T11:11:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:49.589450 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Checking router: fa48cfa6-fa67-479e-86c6-8eea862fb754 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:11:49.590144 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Updating router fa48cfa6-fa67-479e-86c6-8eea862fb754 port cf997a22-dc15-4e60-8145-58a514804936 binding host dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:11:49.643982 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c7ec9ea8-7dd7-4e93-8fde-2e3062e76779 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:49.647796 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:49.699685 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-c7ec9ea8-7dd7-4e93-8fde-2e3062e76779 None None] For port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=2ea40bcb-0c35-4e50-8ff2-1a55222eba02,segment=NetworkSegment(8323217a-f39d-4f1e-8f5b-826579119c97),segment_id=8323217a-f39d-4f1e-8f5b-826579119c97)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:49.707298 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c7ec9ea8-7dd7-4e93-8fde-2e3062e76779 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:49.709049 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:49.802942 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ec9ea8-7dd7-4e93-8fde-2e3062e76779 None None] Pushing event updated for resources: {'Port': ['ID=2ea40bcb-0c35-4e50-8ff2-1a55222eba02,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:49.816631 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-c7ec9ea8-7dd7-4e93-8fde-2e3062e76779 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:49.892608 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:49.937873 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-db18ae4f-ea21-43d1-b99f-36723638860f None None] Provisioning complete for port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:49.938321 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-db18ae4f-ea21-43d1-b99f-36723638860f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.040093 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Notify callbacks [] for port, precommit_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.056209 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.provisioning_blocks [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Transition to ACTIVE for port object cf997a22-dc15-4e60-8145-58a514804936 will not be triggered until provisioned by entity L2. {{(pid=119243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:50.065458 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.072940 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-f2776f7b-6c22-46fd-9897-b39252029ac1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:50.153342 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Attempting to bind port cf997a22-dc15-4e60-8145-58a514804936 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:11:50.153711 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Attempting to bind port cf997a22-dc15-4e60-8145-58a514804936 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:11:50.154079 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Attempting to bind port cf997a22-dc15-4e60-8145-58a514804936 on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:50.163493 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 11, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:11:50.163946 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:50.164298 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.164691 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:11:50.165166 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Bound port: cf997a22-dc15-4e60-8145-58a514804936, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:11:50.165539 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.196499 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-512a6c14-7250-40e1-a95d-f9c0b16be259 None None] Pushing event updated for resources: {'Port': ['ID=cf997a22-dc15-4e60-8145-58a514804936,revision_number=2']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:50.199861 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-512a6c14-7250-40e1-a95d-f9c0b16be259 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:50.247237 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Allocated IP 172.20.0.1 (c783f943-bfd7-40b4-abd5-264b3d0bdef5/60e72189-c1a7-443f-8dca-6646b19c0101/af8ae178-ea25-4e8a-ab7d-730d8642caac) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:11:50.308829 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] For port cf997a22-dc15-4e60-8145-58a514804936, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:11:50.327899 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] For port cf997a22-dc15-4e60-8145-58a514804936, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=cf997a22-dc15-4e60-8145-58a514804936,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:11:50.336010 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.340582 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-190a8c27-387d-4687-bad9-854939887098 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:50.354729 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device e95624ae-5876-4f15-ad18-6a0cf9360081 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:50.416020 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd216632-8e4c-4d38-8e7a-f2101c1d7077 req-eabc21af-acce-4866-9f64-154cc1b4794a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:50.423121 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd216632-8e4c-4d38-8e7a-f2101c1d7077 req-eabc21af-acce-4866-9f64-154cc1b4794a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1964700
Jun 01 11:11:50.447927 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port e95624ae-5876-4f15-ad18-6a0cf9360081 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:50.448571 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.453073 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.475319 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Transition to ACTIVE for port object af8ae178-ea25-4e8a-ab7d-730d8642caac will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:50.488748 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Routers {'fa48cfa6-fa67-479e-86c6-8eea862fb754'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:11:50.489931 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57984b14c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:11:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['fa48cfa6-fa67-479e-86c6-8eea862fb754'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:50.494220 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446b4274-6cec-4491-a06b-5864b596984b req-725b1e08-d6af-45e2-b735-7f81ddfc4cc2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:50.496323 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-446b4274-6cec-4491-a06b-5864b596984b req-725b1e08-d6af-45e2-b735-7f81ddfc4cc2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.2091508
Jun 01 11:11:50.501827 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd216632-8e4c-4d38-8e7a-f2101c1d7077 req-e58e5f40-2d65-4d87-bfcb-e0c6b41afd47 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0752990
Jun 01 11:11:50.535029 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.543031 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9274bf45-26b0-4ff1-a403-9d05855da3c9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:50.583011 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-512a6c14-7250-40e1-a95d-f9c0b16be259 None None] Pushing event updated for resources: {'Port': ['ID=cf997a22-dc15-4e60-8145-58a514804936,revision_number=3']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:50.596512 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-512a6c14-7250-40e1-a95d-f9c0b16be259 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:50.614811 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-446b4274-6cec-4491-a06b-5864b596984b req-a687fed6-8889-4eaf-bf46-7a91211e6469 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0948639
Jun 01 11:11:50.626876 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:50.642911 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Network c783f943-bfd7-40b4-abd5-264b3d0bdef5 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:50.647131 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:50.649153 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Pushing event updated for resources: {'Port': ['ID=af8ae178-ea25-4e8a-ab7d-730d8642caac,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:50.656461 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:11:50.688448 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.688817 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.689177 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.689530 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.689880 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.690230 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.690574 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.690919 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.691266 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.691692 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.692000 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.692298 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:50.698520 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:50.723049 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] Set router fa48cfa6-fa67-479e-86c6-8eea862fb754 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:11:50.734776 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.734961 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:50.735387 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.874052 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.912344 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-0e51f890-adac-48f0-9a6d-0164d58e2f6f None None] Provisioning for port af8ae178-ea25-4e8a-ab7d-730d8642caac completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:50.917515 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-0e51f890-adac-48f0-9a6d-0164d58e2f6f None None] Provisioning complete for port af8ae178-ea25-4e8a-ab7d-730d8642caac triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:50.917895 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0e51f890-adac-48f0-9a6d-0164d58e2f6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:50.972565 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-0e51f890-adac-48f0-9a6d-0164d58e2f6f None None] Port af8ae178-ea25-4e8a-ab7d-730d8642caac cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:11:51.063343 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57984b14c0>, [{'id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91'}], 'enable_snat': True}, 'gw_port_id': 'cf997a22-dc15-4e60-8145-58a514804936', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:45Z', 'updated_at': '2021-06-01T11:11:47Z', 'revision_number': 3, 'project_id': '65f10d0e259c4764a0a20338456489de', 'gw_port': {'id': 'cf997a22-dc15-4e60-8145-58a514804936', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:ba:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 406, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:46Z', 'updated_at': '2021-06-01T11:11:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:51.069041 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2df9f7f8-046c-4ea5-ac0c-99ccacd16133 None None] The sync data for ids ['fa48cfa6-fa67-479e-86c6-8eea862fb754'] in dv-cinder-787764-3-iscsi is: [{'id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91'}], 'enable_snat': True}, 'gw_port_id': 'cf997a22-dc15-4e60-8145-58a514804936', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:45Z', 'updated_at': '2021-06-01T11:11:47Z', 'revision_number': 3, 'project_id': '65f10d0e259c4764a0a20338456489de', 'gw_port': {'id': 'cf997a22-dc15-4e60-8145-58a514804936', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:ba:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 406, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:46Z', 'updated_at': '2021-06-01T11:11:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:11:51.123715 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:51.129302 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:51.158331 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:51.245934 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:51.252871 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Pushing event updated for resources: {'Port': ['ID=af8ae178-ea25-4e8a-ab7d-730d8642caac,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:51.257993 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:51.434949 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Network c783f943-bfd7-40b4-abd5-264b3d0bdef5 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:11:51.436354 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:11:51.733587 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Router fa48cfa6-fa67-479e-86c6-8eea862fb754 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:11:51.804577 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-7856d256-89bf-4ab3-9a94-e1493637589f None None] Provisioning complete for port af8ae178-ea25-4e8a-ab7d-730d8642caac triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:51.805212 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7856d256-89bf-4ab3-9a94-e1493637589f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:51.906711 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-7856d256-89bf-4ab3-9a94-e1493637589f None None] Port af8ae178-ea25-4e8a-ab7d-730d8642caac cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:11:51.912519 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41e9ab25-1b00-4d59-9ad2-06d960078d50 req-20fd5a0b-0a6a-4e32-b604-cf35514f7db9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:51.914344 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41e9ab25-1b00-4d59-9ad2-06d960078d50 req-20fd5a0b-0a6a-4e32-b604-cf35514f7db9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2112322
Jun 01 11:11:51.970299 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:11:51.970967 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e79142e2-f109-4efd-a9d7-e72f6e4d2817 req-b536bb27-1c0f-45b6-a3f3-abd44dab76c4 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:51.972769 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e79142e2-f109-4efd-a9d7-e72f6e4d2817 req-b536bb27-1c0f-45b6-a3f3-abd44dab76c4 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1498275
Jun 01 11:11:51.979966 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] 10.222.0.74 "PUT /v2.0/routers/fa48cfa6-fa67-479e-86c6-8eea862fb754/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9389281
Jun 01 11:11:52.017806 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41e9ab25-1b00-4d59-9ad2-06d960078d50 req-4ba997a9-bec2-43de-9acd-fd50221680df tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0970850
Jun 01 11:11:52.042223 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e79142e2-f109-4efd-a9d7-e72f6e4d2817 req-1edc59bf-87f1-4953-ab7c-71947b437a0d tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0637209
Jun 01 11:11:52.352329 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device cf997a22-dc15-4e60-8145-58a514804936 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:52.513934 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port cf997a22-dc15-4e60-8145-58a514804936 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:52.519787 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port cf997a22-dc15-4e60-8145-58a514804936 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:52.520372 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:52.736263 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-10eba781-5bf2-44bc-91b4-cccd45a6d941 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:52.751609 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:52.783293 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port cf997a22-dc15-4e60-8145-58a514804936, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=cf997a22-dc15-4e60-8145-58a514804936,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:52.794502 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:52.796414 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:52.954469 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=cf997a22-dc15-4e60-8145-58a514804936,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:52.961102 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:53.353711 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75cb5289-d088-4faf-850d-943771115295 None None] Sync routers for ids ['fa48cfa6-fa67-479e-86c6-8eea862fb754'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:11:53.378637 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75cb5289-d088-4faf-850d-943771115295 None None] Routers {'fa48cfa6-fa67-479e-86c6-8eea862fb754'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:11:53.379289 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-75cb5289-d088-4faf-850d-943771115295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5799111640>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:11:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['fa48cfa6-fa67-479e-86c6-8eea862fb754'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:53.538056 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41e52062-737b-4876-a331-b636b3e85e2f req-0c52e58a-9a26-4424-adff-0ef118e6a576 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:53.539715 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41e52062-737b-4876-a331-b636b3e85e2f req-0c52e58a-9a26-4424-adff-0ef118e6a576 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2302411
Jun 01 11:11:53.548277 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a718d9-febe-480f-a1e2-d9011e1745c0 req-0917ae48-4b14-45a1-83e3-08120121c549 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:53.555299 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b0a718d9-febe-480f-a1e2-d9011e1745c0 req-0917ae48-4b14-45a1-83e3-08120121c549 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1656418
Jun 01 11:11:53.659628 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41e52062-737b-4876-a331-b636b3e85e2f req-612b37c0-4076-45ed-98ef-91d537354509 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1016352
Jun 01 11:11:53.686677 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b0a718d9-febe-480f-a1e2-d9011e1745c0 req-8a541fbb-6dd7-41e3-9211-7e8a35f0f7ce tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1303749
Jun 01 11:11:53.757763 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-75cb5289-d088-4faf-850d-943771115295 None None] Set router fa48cfa6-fa67-479e-86c6-8eea862fb754 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:11:54.342368 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device cf997a22-dc15-4e60-8145-58a514804936 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:54.451379 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port cf997a22-dc15-4e60-8145-58a514804936 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:54.451914 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:54.671118 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-75cb5289-d088-4faf-850d-943771115295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5799111640>, [{'id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91'}], 'enable_snat': True}, 'gw_port_id': 'cf997a22-dc15-4e60-8145-58a514804936', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:45Z', 'updated_at': '2021-06-01T11:11:50Z', 'revision_number': 4, 'project_id': '65f10d0e259c4764a0a20338456489de', 'gw_port': {'id': 'cf997a22-dc15-4e60-8145-58a514804936', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:ba:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 406, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:46Z', 'updated_at': '2021-06-01T11:11:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'af8ae178-ea25-4e8a-ab7d-730d8642caac', 'name': '', 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'mac_address': 'fa:16:3e:ef:7e:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '60e72189-c1a7-443f-8dca-6646b19c0101', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:49Z', 'updated_at': '2021-06-01T11:11:50Z', 'revision_number': 2, 'project_id': '65f10d0e259c4764a0a20338456489de', 'subnets': [{'id': '60e72189-c1a7-443f-8dca-6646b19c0101', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:54.692918 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75cb5289-d088-4faf-850d-943771115295 None None] Checking router: fa48cfa6-fa67-479e-86c6-8eea862fb754 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:11:54.693310 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75cb5289-d088-4faf-850d-943771115295 None None] Updating router fa48cfa6-fa67-479e-86c6-8eea862fb754 port af8ae178-ea25-4e8a-ab7d-730d8642caac binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:11:54.785154 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-75cb5289-d088-4faf-850d-943771115295 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:54.952456 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1fbd643-f9f2-4d2f-966a-45efb71fe5a9 req-fa4b6a9f-7769-491d-96f7-5c4bb59f8edb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:54.964780 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1fbd643-f9f2-4d2f-966a-45efb71fe5a9 req-fa4b6a9f-7769-491d-96f7-5c4bb59f8edb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1129925
Jun 01 11:11:55.400572 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1fbd643-f9f2-4d2f-966a-45efb71fe5a9 req-112cc0af-94b1-41e2-9dde-25b0a54084cd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.4348147
Jun 01 11:11:55.432589 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-24249fb3-00f4-4228-b0c1-ac0d80e69aac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:55.452116 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:55.466166 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f2b65ec-6357-4054-a27c-2429af293b31 req-f0e5de18-4b56-4da4-9d45-6eaf559b62b9 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:55.499152 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7f2b65ec-6357-4054-a27c-2429af293b31 req-f0e5de18-4b56-4da4-9d45-6eaf559b62b9 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.4910023
Jun 01 11:11:55.592967 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-75cb5289-d088-4faf-850d-943771115295 None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:55.615738 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-75cb5289-d088-4faf-850d-943771115295 None None] Transition to ACTIVE for port object af8ae178-ea25-4e8a-ab7d-730d8642caac will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:11:55.626379 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-75cb5289-d088-4faf-850d-943771115295 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:55.630675 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:55.635655 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7f2b65ec-6357-4054-a27c-2429af293b31 req-cb8fdea2-ffc0-4d39-bf41-dcf9e0e3dedd tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1204522
Jun 01 11:11:55.803861 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:11:56.022344 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Pushing event updated for resources: {'Port': ['ID=af8ae178-ea25-4e8a-ab7d-730d8642caac,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:56.051934 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.051934 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.052946 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.052946 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.052946 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.061573 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.061981 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.062309 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.062632 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.062959 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.064004 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.064348 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:11:56.096858 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac6ba5e-69d7-44eb-81fe-5dc179329cf0 req-6c554dd1-6749-4337-8808-35f097b641a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:56.097754 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.467s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:56.098778 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-cac6ba5e-69d7-44eb-81fe-5dc179329cf0 req-6c554dd1-6749-4337-8808-35f097b641a0 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1099 time: 0.1952336
Jun 01 11:11:56.098978 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-75cb5289-d088-4faf-850d-943771115295 None None] Attempting to bind port af8ae178-ea25-4e8a-ab7d-730d8642caac on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:11:56.099334 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-75cb5289-d088-4faf-850d-943771115295 None None] Attempting to bind port af8ae178-ea25-4e8a-ab7d-730d8642caac by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '8323217a-f39d-4f1e-8f5b-826579119c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:11:56.099732 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75cb5289-d088-4faf-850d-943771115295 None None] Attempting to bind port af8ae178-ea25-4e8a-ab7d-730d8642caac on network c783f943-bfd7-40b4-abd5-264b3d0bdef5 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:11:56.106342 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75cb5289-d088-4faf-850d-943771115295 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 11, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:11:56.106848 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75cb5289-d088-4faf-850d-943771115295 None None] Checking segment: {'id': '8323217a-f39d-4f1e-8f5b-826579119c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:11:56.107918 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-75cb5289-d088-4faf-850d-943771115295 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:56.107918 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75cb5289-d088-4faf-850d-943771115295 None None] Bound using segment: {'id': '8323217a-f39d-4f1e-8f5b-826579119c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:11:56.108252 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-75cb5289-d088-4faf-850d-943771115295 None None] Bound port: af8ae178-ea25-4e8a-ab7d-730d8642caac, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8323217a-f39d-4f1e-8f5b-826579119c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:11:56.108633 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-75cb5289-d088-4faf-850d-943771115295 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:56.189957 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-cac6ba5e-69d7-44eb-81fe-5dc179329cf0 req-3c232d8d-2354-41f3-9c3a-b967cdbe491e service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0835030
Jun 01 11:11:56.250241 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-75cb5289-d088-4faf-850d-943771115295 None None] For port af8ae178-ea25-4e8a-ab7d-730d8642caac, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:11:56.257699 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-75cb5289-d088-4faf-850d-943771115295 None None] For port af8ae178-ea25-4e8a-ab7d-730d8642caac, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=af8ae178-ea25-4e8a-ab7d-730d8642caac,segment=NetworkSegment(8323217a-f39d-4f1e-8f5b-826579119c97),segment_id=8323217a-f39d-4f1e-8f5b-826579119c97)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:11:56.279067 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-75cb5289-d088-4faf-850d-943771115295 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:56.287685 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:56.476227 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75cb5289-d088-4faf-850d-943771115295 None None] Routers {'fa48cfa6-fa67-479e-86c6-8eea862fb754'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:11:56.477741 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-75cb5289-d088-4faf-850d-943771115295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5799111640>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:11:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['fa48cfa6-fa67-479e-86c6-8eea862fb754'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:56.572538 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:56.602194 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Pushing event updated for resources: {'Port': ['ID=af8ae178-ea25-4e8a-ab7d-730d8642caac,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:56.606581 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:56.855155 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027565ba-4dbc-470c-bff0-4e46eb180b84 req-e150e5d2-8dee-4e7a-af7b-d959a5c1b4eb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:56.858355 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-027565ba-4dbc-470c-bff0-4e46eb180b84 req-e150e5d2-8dee-4e7a-af7b-d959a5c1b4eb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2007444
Jun 01 11:11:56.944230 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-75cb5289-d088-4faf-850d-943771115295 None None] Set router fa48cfa6-fa67-479e-86c6-8eea862fb754 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:11:56.946163 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-027565ba-4dbc-470c-bff0-4e46eb180b84 req-66949286-670b-404d-9fe7-f197bb99b56e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0822775
Jun 01 11:11:57.085191 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c5216b-dd29-4207-b154-a8435ba51f11 req-77d33993-85d1-4366-893b-aa5bcac5cf72 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:57.090078 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a5c5216b-dd29-4207-b154-a8435ba51f11 req-77d33993-85d1-4366-893b-aa5bcac5cf72 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1780524
Jun 01 11:11:57.208958 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a5c5216b-dd29-4207-b154-a8435ba51f11 req-079017d1-4b63-4a5e-8492-01eddcf4a691 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1131289
Jun 01 11:11:57.520504 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-75cb5289-d088-4faf-850d-943771115295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5799111640>, [{'id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91'}], 'enable_snat': True}, 'gw_port_id': 'cf997a22-dc15-4e60-8145-58a514804936', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:45Z', 'updated_at': '2021-06-01T11:11:50Z', 'revision_number': 4, 'project_id': '65f10d0e259c4764a0a20338456489de', 'gw_port': {'id': 'cf997a22-dc15-4e60-8145-58a514804936', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:ba:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 406, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:46Z', 'updated_at': '2021-06-01T11:11:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'af8ae178-ea25-4e8a-ab7d-730d8642caac', 'name': '', 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'mac_address': 'fa:16:3e:ef:7e:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '60e72189-c1a7-443f-8dca-6646b19c0101', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:49Z', 'updated_at': '2021-06-01T11:11:56Z', 'revision_number': 4, 'project_id': '65f10d0e259c4764a0a20338456489de', 'subnets': [{'id': '60e72189-c1a7-443f-8dca-6646b19c0101', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:11:57.526010 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75cb5289-d088-4faf-850d-943771115295 None None] The sync data for ids ['fa48cfa6-fa67-479e-86c6-8eea862fb754'] in dv-cinder-787764-3-iscsi is: [{'id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91'}], 'enable_snat': True}, 'gw_port_id': 'cf997a22-dc15-4e60-8145-58a514804936', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:45Z', 'updated_at': '2021-06-01T11:11:50Z', 'revision_number': 4, 'project_id': '65f10d0e259c4764a0a20338456489de', 'gw_port': {'id': 'cf997a22-dc15-4e60-8145-58a514804936', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:ba:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 406, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:46Z', 'updated_at': '2021-06-01T11:11:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'af8ae178-ea25-4e8a-ab7d-730d8642caac', 'name': '', 'network_id': 'c783f943-bfd7-40b4-abd5-264b3d0bdef5', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'mac_address': 'fa:16:3e:ef:7e:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '60e72189-c1a7-443f-8dca-6646b19c0101', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:49Z', 'updated_at': '2021-06-01T11:11:56Z', 'revision_number': 4, 'project_id': '65f10d0e259c4764a0a20338456489de', 'subnets': [{'id': '60e72189-c1a7-443f-8dca-6646b19c0101', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:11:57.736990 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:58.278220 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bfd7551-0d56-4691-9d86-e76e282c0942 req-c72be6ab-eb96-474b-8d3e-7daa9d17a254 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:58.280344 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8bfd7551-0d56-4691-9d86-e76e282c0942 req-c72be6ab-eb96-474b-8d3e-7daa9d17a254 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1545861
Jun 01 11:11:58.381665 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8bfd7551-0d56-4691-9d86-e76e282c0942 req-1aab25a7-cb84-4a80-8484-ca7bf85d76fb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0950117
Jun 01 11:11:58.409720 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device af8ae178-ea25-4e8a-ab7d-730d8642caac up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:11:58.562409 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b343c9a1-6226-4d29-b3ff-c009de8a5693 req-78335cfe-41c2-401a-a10d-040c90228c83 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:58.572416 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b343c9a1-6226-4d29-b3ff-c009de8a5693 req-78335cfe-41c2-401a-a10d-040c90228c83 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1794317
Jun 01 11:11:58.593187 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port af8ae178-ea25-4e8a-ab7d-730d8642caac completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:11:58.598613 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port af8ae178-ea25-4e8a-ab7d-730d8642caac triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:11:58.599072 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:58.655635 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b343c9a1-6226-4d29-b3ff-c009de8a5693 req-88687be3-c8ea-42db-b517-21a3108d99ff tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0751791
Jun 01 11:11:58.858272 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:58.942878 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port af8ae178-ea25-4e8a-ab7d-730d8642caac, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=af8ae178-ea25-4e8a-ab7d-730d8642caac,segment=NetworkSegment(8323217a-f39d-4f1e-8f5b-826579119c97),segment_id=8323217a-f39d-4f1e-8f5b-826579119c97)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:11:58.958818 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:11:58.969859 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:11:59.204066 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=af8ae178-ea25-4e8a-ab7d-730d8642caac,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:11:59.217228 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:11:59.968976 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d8bdc96-7c34-4ad8-af18-1343cec12162 req-184d26f8-1e0c-4c7f-b399-9ccb8b78d915 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:59.988774 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4d8bdc96-7c34-4ad8-af18-1343cec12162 req-184d26f8-1e0c-4c7f-b399-9ccb8b78d915 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.3583310
Jun 01 11:11:59.991581 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-24d2de3e-3277-4414-9cc9-36cb3d59ced0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:11:59.997486 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-24d2de3e-3277-4414-9cc9-36cb3d59ced0 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 1099 time: 0.2636771
Jun 01 11:12:00.251569 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4d8bdc96-7c34-4ad8-af18-1343cec12162 req-f4f41192-b203-46a7-9a2c-fb2ee2d52f60 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2616959
Jun 01 11:12:00.375250 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-20f65ee9-bba7-4345-b13f-27703a0b9378 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:00.379242 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-20f65ee9-bba7-4345-b13f-27703a0b9378 service neutron] 10.222.0.79 "GET /v2.0/networks?id=e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 200  len: 919 time: 0.3719633
Jun 01 11:12:00.408292 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb83e528-4c1d-4469-a287-5ca2a2c00991 req-77389d96-8582-4fec-bf00-bceff586a9f5 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:00.429791 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eb83e528-4c1d-4469-a287-5ca2a2c00991 req-77389d96-8582-4fec-bf00-bceff586a9f5 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.3431304
Jun 01 11:12:00.436975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device af8ae178-ea25-4e8a-ab7d-730d8642caac up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:12:00.482125 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-180ab79f-dfad-4ce4-af2a-cf52c9acf216 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24 HTTP/1.1" status: 200  len: 217 time: 0.0916853
Jun 01 11:12:00.560036 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eb83e528-4c1d-4469-a287-5ca2a2c00991 req-cc9352a8-4c1c-41d5-ace5-86d9ce84c090 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1285017
Jun 01 11:12:00.622506 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-e6c6ea76-a283-4e0c-a8c8-d00af12beeb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:00.624269 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-e6c6ea76-a283-4e0c-a8c8-d00af12beeb0 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 200  len: 858 time: 0.1340606
Jun 01 11:12:00.649009 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port af8ae178-ea25-4e8a-ab7d-730d8642caac triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:12:00.652691 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:00.787294 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-ad8c295a-ca21-41bb-8923-9cf1b076b336 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=e8c7dea7-722b-446b-9e9f-d27643e48187&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1550772
Jun 01 11:12:00.945136 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-add4179f-9d13-4ad2-8fba-c2ba61d8ea52 service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1418765
Jun 01 11:12:01.148671 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-e8a3bcae-9324-4263-a302-0f9b0bb29c45 req-d83632cb-f7d2-481c-8c11-93ac6ef5c56c service neutron] 10.222.0.79 "GET /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1903808
Jun 01 11:12:01.615359 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a586c9-b1dd-4bd8-9cb4-3b820e730c23 req-2bcafed4-66d8-401b-96d5-a065bc1a9624 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:01.632251 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-09a586c9-b1dd-4bd8-9cb4-3b820e730c23 req-2bcafed4-66d8-401b-96d5-a065bc1a9624 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1574321
Jun 01 11:12:01.721795 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-09a586c9-b1dd-4bd8-9cb4-3b820e730c23 req-bf803367-a748-4b92-9d33-523e5f3045dc tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0891736
Jun 01 11:12:01.964889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39c2296b-df45-46a8-912d-71b1991f14d9 req-74db1ca0-88fd-496f-9aca-a33f412ba5e1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:01.967060 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-39c2296b-df45-46a8-912d-71b1991f14d9 req-74db1ca0-88fd-496f-9aca-a33f412ba5e1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1954925
Jun 01 11:12:02.041757 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-39c2296b-df45-46a8-912d-71b1991f14d9 req-bea9a897-8ae3-4fb8-a954-c58ddf6472d3 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0668113
Jun 01 11:12:03.044012 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b4724b0-2685-41f7-ac8d-dc8c7a71d10d req-c040293b-76cb-4041-a1cc-24a639730e46 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:03.050189 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9b4724b0-2685-41f7-ac8d-dc8c7a71d10d req-c040293b-76cb-4041-a1cc-24a639730e46 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1697192
Jun 01 11:12:03.195202 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9b4724b0-2685-41f7-ac8d-dc8c7a71d10d req-9e627126-b498-4c3c-912d-0127482938e7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1377959
Jun 01 11:12:03.416535 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-233e2344-40f5-41c7-82e9-b5f44823cfab req-dd8e203c-558e-40d3-a886-19f288fe286c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:03.418154 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-233e2344-40f5-41c7-82e9-b5f44823cfab req-dd8e203c-558e-40d3-a886-19f288fe286c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1270676
Jun 01 11:12:03.555198 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-233e2344-40f5-41c7-82e9-b5f44823cfab req-e9aaf673-bef3-4d2f-8a13-90f3035bb1db tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1306076
Jun 01 11:12:04.583176 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1bae4a1-c30c-4ae6-b351-14b58820a56a req-3f6047cb-c21d-44b5-b3f5-3e85e29b53ec tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:04.586261 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1bae4a1-c30c-4ae6-b351-14b58820a56a req-3f6047cb-c21d-44b5-b3f5-3e85e29b53ec tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.2012839
Jun 01 11:12:04.647403 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1bae4a1-c30c-4ae6-b351-14b58820a56a req-b65a8c88-34ec-4630-a042-ee09a1ec4738 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0543747
Jun 01 11:12:04.892063 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edb1d10-197a-4302-bcef-f05cd973b0fd req-a0fbb4dd-913e-4e55-9d4a-b7cdfc27d106 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:04.894709 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4edb1d10-197a-4302-bcef-f05cd973b0fd req-a0fbb4dd-913e-4e55-9d4a-b7cdfc27d106 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1336102
Jun 01 11:12:04.942073 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4edb1d10-197a-4302-bcef-f05cd973b0fd req-1e7d7fec-9ef9-44f1-a432-220b63f5b108 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417054
Jun 01 11:12:05.898754 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6693e24-d396-41a0-9321-b3d830e56d05 req-3bd757f0-4465-41c0-ac44-135bc9f2dddb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:05.906574 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f6693e24-d396-41a0-9321-b3d830e56d05 req-3bd757f0-4465-41c0-ac44-135bc9f2dddb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1050239
Jun 01 11:12:05.969331 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f6693e24-d396-41a0-9321-b3d830e56d05 req-4f9ef731-ee49-4e9b-b85d-7291c48ebf1e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0617537
Jun 01 11:12:06.720282 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-63295438-da0d-402d-ab3a-118523c16e57 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:06.721722 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-63295438-da0d-402d-ab3a-118523c16e57 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Synchronizing usage tracker for tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c on resource:network {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:12:06.749860 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-63295438-da0d-402d-ab3a-118523c16e57 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Unset dirty status for tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c on resource:network {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:12:06.753505 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-63295438-da0d-402d-ab3a-118523c16e57 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/networks?id=7356920a-571e-467c-9250-df782b9d8129 HTTP/1.1" status: 200  len: 814 time: 0.2988131
Jun 01 11:12:06.770669 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-1abe7885-b138-4491-8419-2e5d097424c5 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/quotas/5c3d0a0f97d246d5a7afac5ec8c4d43c HTTP/1.1" status: 200  len: 375 time: 0.0111253
Jun 01 11:12:06.855346 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-657c75e7-2b46-450f-a335-23722e3e8eb1 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Synchronizing usage tracker for tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:12:06.872091 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-657c75e7-2b46-450f-a335-23722e3e8eb1 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Unset dirty status for tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:12:06.873441 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-657c75e7-2b46-450f-a335-23722e3e8eb1 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0976000
Jun 01 11:12:06.937633 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-e3a196c6-b61a-485a-800b-eda9c2829310 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:06.939112 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-e3a196c6-b61a-485a-800b-eda9c2829310 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 1098 time: 0.0702693
Jun 01 11:12:07.055730 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-c71e894d-1a0c-460d-af0b-9fb1b1510f71 service neutron] 10.222.0.74 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1703823
Jun 01 11:12:07.080754 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-d2198a65-5a3c-4c1b-b4fe-dda15cd2b6fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:07.082612 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-d2198a65-5a3c-4c1b-b4fe-dda15cd2b6fc service neutron] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 917 time: 0.1356342
Jun 01 11:12:07.242174 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-f98aaa95-dc7f-4744-a357-57396cdb7f8d service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=6c613458-8891-4e54-aa10-4a7743587916 HTTP/1.1" status: 200  len: 1001 time: 0.1418662
Jun 01 11:12:07.355437 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-982c28c2-9138-4014-bcd4-1f950163e865 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:07.357177 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-982c28c2-9138-4014-bcd4-1f950163e865 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.1069574
Jun 01 11:12:07.360722 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-4b55211e-1fb2-4d19-920e-5c4e8720ace1 service neutron] 10.222.0.74 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3041325
Jun 01 11:12:07.376030 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d73cb2-aa1c-44c9-8ca6-6c22cffdaf38 req-d8f04366-0641-4d7d-86e9-600ce9746dbd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:07.383293 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-97d73cb2-aa1c-44c9-8ca6-6c22cffdaf38 req-d8f04366-0641-4d7d-86e9-600ce9746dbd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1360805
Jun 01 11:12:07.445087 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-97d73cb2-aa1c-44c9-8ca6-6c22cffdaf38 req-8bbdb61d-b21c-483a-8f0d-8050121936c5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0605650
Jun 01 11:12:07.491197 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-4b4796d8-d539-4170-8948-ae09df2488aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:07.494163 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-4b4796d8-d539-4170-8948-ae09df2488aa service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1115413
Jun 01 11:12:07.641663 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9db18209-6056-4d13-91ff-42ce5c1e2dce req-99cdce8b-dfb5-4e27-96e1-b04d46cc39ee tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 210 time: 0.0639277
Jun 01 11:12:07.671821 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-9ae55953-29b1-4827-8d2a-e4242bb44f6f service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1705761
Jun 01 11:12:07.925170 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-621e5ff1-8f9c-46fb-9521-b70df8dca3e1 req-65f7194b-378c-4368-b676-596b1fba8dbd service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2442629
Jun 01 11:12:08.694412 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ab1da2-7584-4193-a79a-e90ba43a7076 req-181626a5-805f-4aba-9254-7f03c6395bd3 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:08.718965 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e3ab1da2-7584-4193-a79a-e90ba43a7076 req-181626a5-805f-4aba-9254-7f03c6395bd3 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1520264
Jun 01 11:12:08.809933 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e3ab1da2-7584-4193-a79a-e90ba43a7076 req-3f8f06e2-c306-4bc6-9f86-b1186fd75bcc tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0895820
Jun 01 11:12:08.955983 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-293de5ef-9df5-4fce-9cee-c0ec3e0462c7 req-0ecbc7ed-6ae8-4ebe-ae1d-e52302b14bb6 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 210 time: 0.0821450
Jun 01 11:12:09.548915 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-13f3d354-0671-4167-a54b-85af11aa8de9 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:09.551152 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-13f3d354-0671-4167-a54b-85af11aa8de9 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.79 "GET /v2.0/networks?id=7356920a-571e-467c-9250-df782b9d8129 HTTP/1.1" status: 200  len: 814 time: 0.3402994
Jun 01 11:12:09.570023 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'port': {'device_id': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'admin_state_up': True, 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:12:09.836107 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:12:09.867302 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:12:09.884024 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Made reservation on behalf of 5c3d0a0f97d246d5a7afac5ec8c4d43c for: {'port': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:12:09.888104 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:10.072957 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da9f68e0-7a9d-4d34-a6ca-260173efd07f req-d096b8cb-76c6-4c74-b8d0-272643c05976 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:10.091433 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-da9f68e0-7a9d-4d34-a6ca-260173efd07f req-d096b8cb-76c6-4c74-b8d0-272643c05976 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 945 time: 0.1236453
Jun 01 11:12:10.357495 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Allocated IP 172.20.0.3 (7356920a-571e-467c-9250-df782b9d8129/c5b015bf-9c86-450a-8cbd-8892adfddfb6/f413cb23-a18e-4d8d-ab19-6cd2b065bc6f) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:12:10.398140 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3045ac3c-905d-4161-b918-46db95ccde1a req-093d568e-4b6b-440c-8185-c975d36b605c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 210 time: 0.0761056
Jun 01 11:12:10.412225 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-da9f68e0-7a9d-4d34-a6ca-260173efd07f req-e3275029-f653-4712-9b4c-61e87d17de8a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3184085
Jun 01 11:12:10.559459 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:12:10.763197 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:10.788105 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:10.808796 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Transition to ACTIVE for port object f413cb23-a18e-4d8d-ab19-6cd2b065bc6f will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:12:10.851080 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:10.852344 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6c613458-8891-4e54-aa10-4a7743587916'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:12:10.856309 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:10.864327 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1662f0c-edf1-446b-be41-6fa5e1db3eca" -d '{"events": [{"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-unplugged", "status": "completed", "tag": "6c613458-8891-4e54-aa10-4a7743587916"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:12:10.873774 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:10.880110 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:10.890912 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:11.001796 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 01 Jun 2021 11:12:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d75fdadc-0645-41d1-9090-5ae618f26bd8 x-openstack-request-id: req-d75fdadc-0645-41d1-9090-5ae618f26bd8 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:12:11.002080 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-unplugged", "status": "completed", "tag": "6c613458-8891-4e54-aa10-4a7743587916", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:12:11.002330 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-d75fdadc-0645-41d1-9090-5ae618f26bd8 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:12:11.007194 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6c613458-8891-4e54-aa10-4a7743587916', 'code': 200}
Jun 01 11:12:11.034782 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Network 7356920a-571e-467c-9250-df782b9d8129 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:12:11.047504 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:12:11.060434 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:12:11.078523 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=8']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:11.085386 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:11.140396 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'Port': ['ID=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:11.148484 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:11.178500 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:11.189019 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:11.261033 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.6959515
Jun 01 11:12:11.304627 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Request body: {'port': {'device_id': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:12:11.466185 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a18fc57e-8e2f-4426-9253-b3b589c3f2d1 None None] Provisioning for port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:12:11.487940 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a18fc57e-8e2f-4426-9253-b3b589c3f2d1 None None] Provisioning complete for port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:12:11.499171 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a18fc57e-8e2f-4426-9253-b3b589c3f2d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:11.613907 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:11.630108 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a18fc57e-8e2f-4426-9253-b3b589c3f2d1 None None] Port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:12:11.906460 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1356238-39cd-487b-8052-035c1f479873 req-b583050f-cf0f-4205-82c8-ac84931ed2c6 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.4611063
Jun 01 11:12:11.933340 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80057ad-d6ce-482f-a40a-04e9c6dc4d18 req-c3feb513-b2bd-477e-adc9-defbc8973981 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:11.944750 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a80057ad-d6ce-482f-a40a-04e9c6dc4d18 req-c3feb513-b2bd-477e-adc9-defbc8973981 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 931 time: 0.3441586
Jun 01 11:12:12.068055 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-a80057ad-d6ce-482f-a40a-04e9c6dc4d18 req-7adb4649-0b91-4442-930c-09f603f907e3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Synchronizing usage tracker for tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:12:12.125286 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-a80057ad-d6ce-482f-a40a-04e9c6dc4d18 req-7adb4649-0b91-4442-930c-09f603f907e3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Unset dirty status for tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:12:12.135236 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a80057ad-d6ce-482f-a40a-04e9c6dc4d18 req-7adb4649-0b91-4442-930c-09f603f907e3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1891768
Jun 01 11:12:12.178224 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24192921-701c-4b70-a2a8-526b003111c8 req-04b48b9e-6c00-409d-9f3d-9f200b12842a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:12.182136 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-24192921-701c-4b70-a2a8-526b003111c8 req-04b48b9e-6c00-409d-9f3d-9f200b12842a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.4376395
Jun 01 11:12:12.183631 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f413cb23-a18e-4d8d-ab19-6cd2b065bc6f {{(pid=119240) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:12:12.193687 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:12.212903 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Transition to ACTIVE for port object f413cb23-a18e-4d8d-ab19-6cd2b065bc6f will not be triggered until provisioned by entity L2. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:12:12.222111 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:12.227417 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:12.268753 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1356238-39cd-487b-8052-035c1f479873 req-1459102b-00e2-421d-8057-abbde1524f9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:12.275780 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1356238-39cd-487b-8052-035c1f479873 req-1459102b-00e2-421d-8057-abbde1524f9b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 1098 time: 0.2856767
Jun 01 11:12:12.370565 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-24192921-701c-4b70-a2a8-526b003111c8 req-9bce1625-d9b7-4f78-911e-4a797ad65933 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1737902
Jun 01 11:12:12.853638 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Pushing event updated for resources: {'Port': ['ID=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:12.867263 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.640s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:12.941000 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1356238-39cd-487b-8052-035c1f479873 req-34236345-5f5e-4294-88d7-9ae6bd7b9d5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:12.947632 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1356238-39cd-487b-8052-035c1f479873 req-34236345-5f5e-4294-88d7-9ae6bd7b9d5b service neutron] 10.222.0.79 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 911 time: 0.5759075
Jun 01 11:12:12.981182 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97e6f5f-eb9c-4743-bd25-4c4eefe9655a req-6e1bd40e-8b29-4271-aa58-ddbf1755596c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:12.996234 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e97e6f5f-eb9c-4743-bd25-4c4eefe9655a req-6e1bd40e-8b29-4271-aa58-ddbf1755596c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.5088768
Jun 01 11:12:13.108608 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Attempting to bind port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:12:13.108985 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Attempting to bind port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:12:13.111406 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Attempting to bind port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f on network 7356920a-571e-467c-9250-df782b9d8129 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:12:13.120747 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f on network 7356920a-571e-467c-9250-df782b9d8129 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:12:13.121180 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Attempting to bind port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f on network 7356920a-571e-467c-9250-df782b9d8129 {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:12:13.132809 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 11, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:12:13.135568 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Checking segment: {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:12:13.136530 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Bound using segment: {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'} {{(pid=119240) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:12:13.137767 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.managers [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Bound port: f413cb23-a18e-4d8d-ab19-6cd2b065bc6f, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ecc23ea4-0a3f-4193-b594-468b9b7873c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': '7356920a-571e-467c-9250-df782b9d8129'}}] {{(pid=119240) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:12:13.139228 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:13.195367 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e97e6f5f-eb9c-4743-bd25-4c4eefe9655a req-68b50235-6dc8-4d00-afa3-352e7c0da6e1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1950862
Jun 01 11:12:13.211772 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1356238-39cd-487b-8052-035c1f479873 req-68751e35-984d-44d5-875d-d527bac38d02 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263 HTTP/1.1" status: 200  len: 1000 time: 0.2070937
Jun 01 11:12:13.328655 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1356238-39cd-487b-8052-035c1f479873 req-58f176b5-bc87-4c90-ad3f-6ee101bf078a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:13.330127 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1356238-39cd-487b-8052-035c1f479873 req-58f176b5-bc87-4c90-ad3f-6ee101bf078a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=08c4a15d-0d06-4d4b-909f-10ac28c5c16c HTTP/1.1" status: 200  len: 849 time: 0.0991864
Jun 01 11:12:13.454510 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] For port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f, host hv-cinder-78776, cleared binding levels {{(pid=119240) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:12:13.460440 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] For port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119240) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:12:13.477022 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:13.482848 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9de22bb7-de01-4903-ae97-e4173340db1f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:13.666869 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Pushing event updated for resources: {'Port': ['ID=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,revision_number=3']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:13.679854 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:13.710368 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:13.714518 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:13.716137 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] 10.222.0.79 "PUT /v2.0/ports/f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 1093 time: 2.4158332
Jun 01 11:12:13.716672 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:12:13.719082 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-059c0d9f-e7d4-4969-98cb-a55062d92cab" -d '{"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:12:13.824897 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1356238-39cd-487b-8052-035c1f479873 req-36fb62db-4175-4b2e-91e5-0267262b1b99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:13.826592 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1356238-39cd-487b-8052-035c1f479873 req-36fb62db-4175-4b2e-91e5-0267262b1b99 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=418faffe-faca-4025-ab0f-56771435263e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.4752574
Jun 01 11:12:13.844337 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abea8bd8-3a85-484d-ad5e-cae3493e6fa0 req-14749838-b90c-47b3-b201-c46788115ed2 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:13.851205 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-abea8bd8-3a85-484d-ad5e-cae3493e6fa0 req-14749838-b90c-47b3-b201-c46788115ed2 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.3385015
Jun 01 11:12:13.958688 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-abea8bd8-3a85-484d-ad5e-cae3493e6fa0 req-d09b443a-1422-4e34-b9ed-f826dcffd95c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0910850
Jun 01 11:12:14.007126 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:12:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-623c7b36-f033-4fed-8563-cbae67d87198 x-openstack-request-id: req-623c7b36-f033-4fed-8563-cbae67d87198 {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:12:14.007514 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:12:14.007892 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-623c7b36-f033-4fed-8563-cbae67d87198 {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:12:14.008419 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'status': 'completed', 'code': 200}
Jun 01 11:12:14.510272 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fe2475-9a65-4cf6-b478-5a9820a5c53a req-5ee6b56c-8c33-40dd-9d6c-515f5489fe19 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:14.527148 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-56fe2475-9a65-4cf6-b478-5a9820a5c53a req-5ee6b56c-8c33-40dd-9d6c-515f5489fe19 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.2419920
Jun 01 11:12:14.570533 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:12:14.658056 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-56fe2475-9a65-4cf6-b478-5a9820a5c53a req-043cbf05-536d-4e79-a7f2-d93d1557a4a0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1299605
Jun 01 11:12:14.987804 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1356238-39cd-487b-8052-035c1f479873 req-e9bb1595-610c-4dd6-8bc2-692acaddfd86 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3153384
Jun 01 11:12:14.990742 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-059c0d9f-e7d4-4969-98cb-a55062d92cab req-852fa253-b2a8-49a9-8ab1-75fdbb991a83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:14.992846 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-059c0d9f-e7d4-4969-98cb-a55062d92cab req-852fa253-b2a8-49a9-8ab1-75fdbb991a83 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1096 time: 0.1990933
Jun 01 11:12:15.363050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-059c0d9f-e7d4-4969-98cb-a55062d92cab req-a68ea870-f1dd-4ab2-9724-54c2d8a54732 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:15.369222 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-059c0d9f-e7d4-4969-98cb-a55062d92cab req-a68ea870-f1dd-4ab2-9724-54c2d8a54732 service neutron] 10.222.0.79 "GET /v2.0/networks?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&shared=False HTTP/1.1" status: 200  len: 915 time: 0.3361712
Jun 01 11:12:15.451691 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d147955-f187-4606-8ac5-a74a025bda25 req-c01bc80a-bf09-460c-951d-83b6aa85bd8c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:15.460785 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6d147955-f187-4606-8ac5-a74a025bda25 req-c01bc80a-bf09-460c-951d-83b6aa85bd8c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.4716747
Jun 01 11:12:15.582812 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e1356238-39cd-487b-8052-035c1f479873 req-c1343919-02bd-44ba-81d9-5f238a6bae57 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5282781
Jun 01 11:12:15.625496 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6d147955-f187-4606-8ac5-a74a025bda25 req-0cf8176d-623b-473c-8b84-b3e865a395f1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1634529
Jun 01 11:12:15.683159 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf3f657-f5ec-41e6-9806-7ee648a5c886 req-95422045-f7d2-4f6c-9fed-d3afb3389f71 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:15.693522 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8cf3f657-f5ec-41e6-9806-7ee648a5c886 req-95422045-f7d2-4f6c-9fed-d3afb3389f71 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.1748235
Jun 01 11:12:15.841548 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8cf3f657-f5ec-41e6-9806-7ee648a5c886 req-d42d0922-0991-45a8-8148-d6ce7b84bf80 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1468043
Jun 01 11:12:15.929887 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-059c0d9f-e7d4-4969-98cb-a55062d92cab req-a4edf512-ae20-476d-b413-05841ddf9abf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:15.931974 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-059c0d9f-e7d4-4969-98cb-a55062d92cab req-a4edf512-ae20-476d-b413-05841ddf9abf service neutron] 10.222.0.79 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.3963013
Jun 01 11:12:16.351052 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806418ef-05c3-4c8e-83ec-27324289b265 req-c4f9fd53-3a49-473b-a414-1204fec30644 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:16.356645 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-806418ef-05c3-4c8e-83ec-27324289b265 req-c4f9fd53-3a49-473b-a414-1204fec30644 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.4537053
Jun 01 11:12:16.471152 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-806418ef-05c3-4c8e-83ec-27324289b265 req-77f6d8f7-43c9-47f3-b4e6-3bb26998ff22 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1078439
Jun 01 11:12:16.580789 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:16.904867 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9996f682-eda8-4c30-9dcd-01036d9d327b req-5ff62d15-ce81-4c45-8924-31ed011694f0 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:16.906576 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9996f682-eda8-4c30-9dcd-01036d9d327b req-5ff62d15-ce81-4c45-8924-31ed011694f0 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1273980
Jun 01 11:12:17.005535 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9996f682-eda8-4c30-9dcd-01036d9d327b req-3af3358b-063e-41fc-a9b6-85d82c6983b9 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0900757
Jun 01 11:12:17.265097 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d49a4fa-5a24-4785-8970-b3df91d34666 req-1f1b561f-e506-4133-954b-2f6aa06f1390 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:17.268570 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0d49a4fa-5a24-4785-8970-b3df91d34666 req-1f1b561f-e506-4133-954b-2f6aa06f1390 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.2555542
Jun 01 11:12:17.342377 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0d49a4fa-5a24-4785-8970-b3df91d34666 req-1b94ace2-9421-4bec-a918-b7676f0171f8 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0633159
Jun 01 11:12:17.884629 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54cbb811-43b5-4fba-b6fe-a3884178b3c7 req-4c63fc40-7c2d-4ca9-a1f8-a327ac899ba0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:17.896315 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-54cbb811-43b5-4fba-b6fe-a3884178b3c7 req-4c63fc40-7c2d-4ca9-a1f8-a327ac899ba0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1685405
Jun 01 11:12:17.958664 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-54cbb811-43b5-4fba-b6fe-a3884178b3c7 req-d41c7b68-39cc-4004-af5d-1b76564fb86e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0606112
Jun 01 11:12:18.251482 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad821224-5892-4777-a15a-8bd9a8d3a831 req-dd6d335b-8cb3-4b1a-b064-92418da426ff tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:18.253109 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad821224-5892-4777-a15a-8bd9a8d3a831 req-dd6d335b-8cb3-4b1a-b064-92418da426ff tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1046174
Jun 01 11:12:18.336185 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad821224-5892-4777-a15a-8bd9a8d3a831 req-97240e81-4caf-4d8a-850a-44fcf6898f44 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0760341
Jun 01 11:12:18.650279 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0892aa0e-18f7-4776-964c-495af1beaafa req-6fe78ac1-f7b2-492e-b5ee-83bf1b5ed0c1 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:18.659493 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0892aa0e-18f7-4776-964c-495af1beaafa req-6fe78ac1-f7b2-492e-b5ee-83bf1b5ed0c1 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.1488974
Jun 01 11:12:18.729830 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0892aa0e-18f7-4776-964c-495af1beaafa req-a39d24c9-eb77-462d-bfc9-b9314b951fec tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0692341
Jun 01 11:12:19.271139 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd58a9f-d206-4f20-b62d-9501a32425ba req-6e3c3f8c-e496-4420-8c99-7223e0884973 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:19.275157 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fdd58a9f-d206-4f20-b62d-9501a32425ba req-6e3c3f8c-e496-4420-8c99-7223e0884973 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1681359
Jun 01 11:12:19.394897 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fdd58a9f-d206-4f20-b62d-9501a32425ba req-d8661077-a0cb-4920-80e5-bd1c2f6ce4a2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1058297
Jun 01 11:12:19.720218 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25438c8d-8581-4f2d-b92f-f93fb8beb400 req-a71525b1-6fc4-4a0a-bd18-74a01d0daff4 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:19.722301 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-25438c8d-8581-4f2d-b92f-f93fb8beb400 req-a71525b1-6fc4-4a0a-bd18-74a01d0daff4 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1659629
Jun 01 11:12:19.817337 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-25438c8d-8581-4f2d-b92f-f93fb8beb400 req-1ebfba71-660a-448e-ae09-f1fe50761c00 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0876634
Jun 01 11:12:19.999639 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7938ad3-dd8b-4486-8e37-3a39d50baaba req-8cc0b4c6-73bb-4372-98e5-da1f51733715 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:19.999639 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d7938ad3-dd8b-4486-8e37-3a39d50baaba req-8cc0b4c6-73bb-4372-98e5-da1f51733715 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.1094337
Jun 01 11:12:20.067972 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d7938ad3-dd8b-4486-8e37-3a39d50baaba req-54259029-8dc4-42e4-a05d-17549db3b65a tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0630586
Jun 01 11:12:20.644706 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c684d4df-bcf0-4567-a14b-43b1cc743b5c req-656df0db-b7e2-4388-8b9e-4785849fb101 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:20.646701 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c684d4df-bcf0-4567-a14b-43b1cc743b5c req-656df0db-b7e2-4388-8b9e-4785849fb101 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1144421
Jun 01 11:12:20.744129 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c684d4df-bcf0-4567-a14b-43b1cc743b5c req-8d81f836-7497-40fb-a9b0-c503f137d693 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0906694
Jun 01 11:12:21.079389 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb741b67-bfd8-45b7-a9bf-0f88eedca87f req-dd482f99-ad40-438b-b96c-33b8216f695b tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:21.086620 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cb741b67-bfd8-45b7-a9bf-0f88eedca87f req-dd482f99-ad40-438b-b96c-33b8216f695b tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1371675
Jun 01 11:12:21.181170 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cb741b67-bfd8-45b7-a9bf-0f88eedca87f req-af5b771a-3068-4f36-86f7-8191e2d705ac tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0917475
Jun 01 11:12:21.456284 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102ed5ec-e870-4761-b8ec-6ecf8b373dc9 req-8d5aa316-73eb-47cb-ac0b-43afcbdb8c1f tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:21.463336 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-102ed5ec-e870-4761-b8ec-6ecf8b373dc9 req-8d5aa316-73eb-47cb-ac0b-43afcbdb8c1f tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.2241225
Jun 01 11:12:21.511053 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-102ed5ec-e870-4761-b8ec-6ecf8b373dc9 req-963fa59a-2639-49fe-af97-66d207c6c952 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457444
Jun 01 11:12:22.013004 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a077b35b-a2ad-4162-aaab-3ad8b1c73f8d req-f05adcac-2bbe-4202-9a13-9a8189cd6078 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:22.014785 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a077b35b-a2ad-4162-aaab-3ad8b1c73f8d req-f05adcac-2bbe-4202-9a13-9a8189cd6078 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1486509
Jun 01 11:12:22.094429 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a077b35b-a2ad-4162-aaab-3ad8b1c73f8d req-b294bf40-38bd-4405-a053-63c7ec1b80b0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0727069
Jun 01 11:12:22.543623 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87cfab0c-f7e2-4f8c-bb95-df6807e33269 req-2d4f8bb4-e725-48f4-a1ea-0256764d79bb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:22.553863 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-87cfab0c-f7e2-4f8c-bb95-df6807e33269 req-2d4f8bb4-e725-48f4-a1ea-0256764d79bb tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.2210252
Jun 01 11:12:22.649720 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-87cfab0c-f7e2-4f8c-bb95-df6807e33269 req-74240930-4a52-4537-95f6-6328cd12915e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0948763
Jun 01 11:12:22.715072 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-cd9043c3-64b7-47a8-8628-92983b661392 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:22.745451 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34776) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:22.845583 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edeae609-13f1-44c5-be23-3551a514a8f4 req-57df46c8-a761-4981-8e34-382fe869651f tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:22.847964 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-edeae609-13f1-44c5-be23-3551a514a8f4 req-57df46c8-a761-4981-8e34-382fe869651f tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.1373887
Jun 01 11:12:22.933129 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:22.956336 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:12:22.960275 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-edeae609-13f1-44c5-be23-3551a514a8f4 req-94673a6b-8a73-49bb-876a-b5cdc86dbffb tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1058698
Jun 01 11:12:22.963457 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Usage tracker for resource:security_group_rule and tenant:c38ea03567704aef95838e8159989b99 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:12:22.967641 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:12:22.977186 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:12:23.074224 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:23.081763 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:23.115822 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-724c941b-27c0-49fc-9ae9-9eb91c63707a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:23.128860 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=c38ea03567704aef95838e8159989b99&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3823040
Jun 01 11:12:23.131889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 34782) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:23.155462 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a4b20ab-ad17-447e-ad1a-370b83df74ba,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:23.159561 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:23.210980 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:23.256818 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:23.530252 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f69997e0-90a7-481c-b957-bd766cb1578d req-323f619a-7783-410d-8c30-ece15a12f8e0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:23.531946 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f69997e0-90a7-481c-b957-bd766cb1578d req-323f619a-7783-410d-8c30-ece15a12f8e0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.2502918
Jun 01 11:12:23.532649 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:23.536790 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b48f4e90-85bc-43b7-804b-528204af42fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:23.588118 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a4b20ab-ad17-447e-ad1a-370b83df74ba,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:23.613025 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:23.617987 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/7a4b20ab-ad17-447e-ad1a-370b83df74ba HTTP/1.1" status: 204  len: 168 time: 0.4807489
Jun 01 11:12:23.665578 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.665953 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.666329 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.667247 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.667886 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.668146 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.668527 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.668876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.669229 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.669813 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.680556 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.681646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:23.723465 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:23.745445 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f69997e0-90a7-481c-b957-bd766cb1578d req-5978f299-46fa-4b67-ab58-e958862cae91 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1910541
Jun 01 11:12:24.046516 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da399c50-65a4-4219-af2e-567baeee1939 req-146adc9f-5a8a-4201-ab0e-65bc5fc1affc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:24.058393 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-da399c50-65a4-4219-af2e-567baeee1939 req-146adc9f-5a8a-4201-ab0e-65bc5fc1affc tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1741340
Jun 01 11:12:24.175487 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-da399c50-65a4-4219-af2e-567baeee1939 req-e0c962ec-5df8-406c-855a-a38e3f313256 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1160817
Jun 01 11:12:24.294503 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ceec89-ad55-48d3-86ac-bff17671481f req-8db1ad66-0201-4f86-9ffd-ee1e58bbbb12 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:24.296170 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-58ceec89-ad55-48d3-86ac-bff17671481f req-8db1ad66-0201-4f86-9ffd-ee1e58bbbb12 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.1177757
Jun 01 11:12:24.440866 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-58ceec89-ad55-48d3-86ac-bff17671481f req-1522b347-4d85-4fca-89a3-b078e7b38c6d tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1382911
Jun 01 11:12:25.057049 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d788f3b0-afd0-4b4f-9a52-c4485a175fd3 req-f791c1ea-f7f8-486a-8c97-5e49f8d95f4c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:25.064597 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d788f3b0-afd0-4b4f-9a52-c4485a175fd3 req-f791c1ea-f7f8-486a-8c97-5e49f8d95f4c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1077745
Jun 01 11:12:25.107921 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34818) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:25.170625 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d788f3b0-afd0-4b4f-9a52-c4485a175fd3 req-366b702f-d6e2-47d8-a685-4b98b95fbff4 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1039853
Jun 01 11:12:25.255819 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-61112540-a1f0-4dc5-8942-389cbf98913a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:25.329985 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:25.360165 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-cd89fa5a-7506-4cb7-9070-d666b1e3d7b6 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.2461643
Jun 01 11:12:25.392945 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-c9351b1d-22a4-40d9-a8d4-13b74768d7d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:25.395012 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-c9351b1d-22a4-40d9-a8d4-13b74768d7d4 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1096 time: 0.1383152
Jun 01 11:12:25.474273 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0446d328-d63a-4e31-8424-1bd820a32d64 req-2c482e52-0716-47a6-b450-7d0e69ee6fe5 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:25.485554 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0446d328-d63a-4e31-8424-1bd820a32d64 req-2c482e52-0716-47a6-b450-7d0e69ee6fe5 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1255233
Jun 01 11:12:25.548158 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0446d328-d63a-4e31-8424-1bd820a32d64 req-fcd2c913-aed5-49cc-a27f-83bbb8261db9 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599141
Jun 01 11:12:25.578036 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-436cd69a-a381-4595-91f7-fbbe68113356 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 217 time: 0.1660721
Jun 01 11:12:25.712164 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-8cdb53bc-5571-4779-9667-e15a8a0edd26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:25.715649 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-8cdb53bc-5571-4779-9667-e15a8a0edd26 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=c5b015bf-9c86-450a-8cbd-8892adfddfb6 HTTP/1.1" status: 200  len: 853 time: 0.1219318
Jun 01 11:12:25.886952 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-38b256c3-8bb5-49ce-8a80-23255fa606c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:25.889411 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-38b256c3-8bb5-49ce-8a80-23255fa606c1 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7356920a-571e-467c-9250-df782b9d8129&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1641939
Jun 01 11:12:25.889549 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6cd862-3af6-4e39-aa92-df7f64af89ad req-4cab31c5-0a0a-48d6-a65f-d745a67b19c6 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:25.892944 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ee6cd862-3af6-4e39-aa92-df7f64af89ad req-4cab31c5-0a0a-48d6-a65f-d745a67b19c6 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.1912651
Jun 01 11:12:26.000176 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ee6cd862-3af6-4e39-aa92-df7f64af89ad req-066b0105-254a-46e7-a02c-7e9b16b034b4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0897121
Jun 01 11:12:26.120286 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-0e7d21f2-7748-4a8f-bdd7-248a18c0742f service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2232835
Jun 01 11:12:26.277150 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-a6c10919-cb9d-4bb6-92dc-2ce5c4a8090e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:26.284678 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-a6c10919-cb9d-4bb6-92dc-2ce5c4a8090e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.79 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.1676083
Jun 01 11:12:26.300133 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-c5948950-2e73-4e9e-bfdd-ea8d4f631320 req-34465c05-28a6-40ed-9176-d4270c9355ce service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1723871
Jun 01 11:12:26.382934 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:26.505751 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Deleting port 9f011433-de88-40d6-a527-c916faeb6339 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:12:26.506312 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:26.581483 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-216416b1-8ec7-4b86-9698-8be7ca58a15a req-f3b5dfa2-fe59-48fc-9b4d-af7abe9068a2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:26.583690 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-216416b1-8ec7-4b86-9698-8be7ca58a15a req-f3b5dfa2-fe59-48fc-9b4d-af7abe9068a2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1699352
Jun 01 11:12:26.674546 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-216416b1-8ec7-4b86-9698-8be7ca58a15a req-9a877439-60be-4311-9de7-f6286f953ee9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0820916
Jun 01 11:12:26.688878 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] For port 9f011433-de88-40d6-a527-c916faeb6339, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=9f011433-de88-40d6-a527-c916faeb6339,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:26.689235 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:26.855982 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Calling delete_port for 9f011433-de88-40d6-a527-c916faeb6339 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:12:26.908053 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55d05fa-2ce9-43e5-acdc-b70e2e3d3045 req-1f1e91f0-6f7b-471a-9aa5-32dec056b84e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:26.909544 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a55d05fa-2ce9-43e5-acdc-b70e2e3d3045 req-1f1e91f0-6f7b-471a-9aa5-32dec056b84e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2f8d3be3-e44b-46c1-97d3-b880ab58823a HTTP/1.1" status: 200  len: 945 time: 0.2232158
Jun 01 11:12:26.965326 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a55d05fa-2ce9-43e5-acdc-b70e2e3d3045 req-b2bcb6e1-93ca-4899-82d2-609f3cf10d19 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0497978
Jun 01 11:12:27.032538 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:27.040006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:27.046185 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['b697fc18-c717-4cd5-a5ec-3378e1131e24', '9f011433-de88-40d6-a527-c916faeb6339'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:12:27.114202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Pushing event deleted for resources: {'Port': ['ID=9f011433-de88-40d6-a527-c916faeb6339,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:27.116652 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:27.203871 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] No DVR routers for this DVR port 9f011433-de88-40d6-a527-c916faeb6339 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:12:27.206707 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:27.218872 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f8d3be3-e44b-46c1-97d3-b880ab58823a', 'name': 'network-vif-deleted', 'tag': '9f011433-de88-40d6-a527-c916faeb6339'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:12:27.218872 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40a71602-5d4d-403f-b4ed-5ce035c0e436" -d '{"events": [{"server_uuid": "2f8d3be3-e44b-46c1-97d3-b880ab58823a", "name": "network-vif-deleted", "tag": "9f011433-de88-40d6-a527-c916faeb6339"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:12:27.238692 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4ac9d6a0-f515-4467-b54d-2c7713441365 req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.79 "DELETE /v2.0/ports/9f011433-de88-40d6-a527-c916faeb6339 HTTP/1.1" status: 204  len: 173 time: 0.9456162
Jun 01 11:12:27.263781 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d76c50-710a-4fbe-b48d-366c9f8d7926 req-58462315-d2a8-4d8f-b441-176f83bd0931 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:27.265261 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a4d76c50-710a-4fbe-b48d-366c9f8d7926 req-58462315-d2a8-4d8f-b441-176f83bd0931 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.1411655
Jun 01 11:12:27.266766 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:12:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69b7d0db-7c89-45da-975d-0e3648097ea5 x-openstack-request-id: req-69b7d0db-7c89-45da-975d-0e3648097ea5 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:12:27.267108 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f8d3be3-e44b-46c1-97d3-b880ab58823a", "name": "network-vif-deleted", "tag": "9f011433-de88-40d6-a527-c916faeb6339", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:12:27.267394 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-69b7d0db-7c89-45da-975d-0e3648097ea5 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:12:27.267830 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f8d3be3-e44b-46c1-97d3-b880ab58823a', 'name': 'network-vif-deleted', 'tag': '9f011433-de88-40d6-a527-c916faeb6339', 'status': 'completed', 'code': 200}
Jun 01 11:12:27.315851 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a4d76c50-710a-4fbe-b48d-366c9f8d7926 req-ea4d85fa-6196-499f-8dd6-d88368b86982 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436220
Jun 01 11:12:27.728685 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:27.882211 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5e96707-5c43-4832-9c2e-acfabbba4ad7 req-9b2d3319-64d9-49d5-94b2-65043cf7914d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:27.884513 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e5e96707-5c43-4832-9c2e-acfabbba4ad7 req-9b2d3319-64d9-49d5-94b2-65043cf7914d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0874352
Jun 01 11:12:27.929741 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e5e96707-5c43-4832-9c2e-acfabbba4ad7 req-ad7d167d-5cd8-45c8-8198-df0ac9695ba3 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391777
Jun 01 11:12:28.473346 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f87aac60-6388-46a2-bb51-ce3b4bb7bc80 req-21aaf235-d06e-4c4e-bc92-a09e8c898285 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:28.474033 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-f87aac60-6388-46a2-bb51-ce3b4bb7bc80 req-21aaf235-d06e-4c4e-bc92-a09e8c898285 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Synchronizing usage tracker for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:12:28.502184 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-f87aac60-6388-46a2-bb51-ce3b4bb7bc80 req-21aaf235-d06e-4c4e-bc92-a09e8c898285 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Unset dirty status for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:12:28.503338 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f87aac60-6388-46a2-bb51-ce3b4bb7bc80 req-21aaf235-d06e-4c4e-bc92-a09e8c898285 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1563134
Jun 01 11:12:28.560489 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde56122-e56e-4cd4-abff-9a72acb7ea02 req-8714ca1d-f703-45bd-8ebd-65fa35f9cb48 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:28.562182 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fde56122-e56e-4cd4-abff-9a72acb7ea02 req-8714ca1d-f703-45bd-8ebd-65fa35f9cb48 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 943 time: 0.1358006
Jun 01 11:12:28.567372 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f87aac60-6388-46a2-bb51-ce3b4bb7bc80 req-bed3e54f-c534-4add-aee7-d284dbe63bac tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0561769
Jun 01 11:12:28.647822 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device f413cb23-a18e-4d8d-ab19-6cd2b065bc6f details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:12:28.706185 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fde56122-e56e-4cd4-abff-9a72acb7ea02 req-829d6f8b-ad58-4783-a34a-f8795a45ad11 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1364036
Jun 01 11:12:28.799236 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:28.814268 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'port_id': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'mac_address': 'fa:16:3e:db:2f:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 680, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:12:28.874201 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:28.890660 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f413cb23-a18e-4d8d-ab19-6cd2b065bc6f {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:12:28.905504 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:28.909589 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:28.912294 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:28.976814 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:28.980372 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:29.117044 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8031f58-9f69-4155-82fd-dfe92db54f15 req-1bcfabe6-20fd-46b8-a54b-7079f1c95e03 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:29.118492 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f8031f58-9f69-4155-82fd-dfe92db54f15 req-1bcfabe6-20fd-46b8-a54b-7079f1c95e03 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0799541
Jun 01 11:12:29.162739 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f8031f58-9f69-4155-82fd-dfe92db54f15 req-0f6803f4-9335-472e-b19f-e721371a06ce tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385845
Jun 01 11:12:29.175192 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:12:29.763598 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c0e3c57-32db-4e0b-bbae-1e3a1cb88cf7 req-5e59ed7f-7418-47f7-bdbf-534a3923f866 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:29.765088 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4c0e3c57-32db-4e0b-bbae-1e3a1cb88cf7 req-5e59ed7f-7418-47f7-bdbf-534a3923f866 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0845408
Jun 01 11:12:29.808925 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34946) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:29.811538 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4c0e3c57-32db-4e0b-bbae-1e3a1cb88cf7 req-415f419e-c154-443b-981b-c966d6078608 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403869
Jun 01 11:12:29.869193 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] Deleting subnet 1dfa662b-3182-4cf1-aa42-e313e271a7a1 {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:12:29.872559 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:29.889128 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d942ee2a-ff32-4860-abcc-d6760460f6c7 req-b11471e4-36b5-4ebe-b8de-81d8ec830f56 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:29.890581 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d942ee2a-ff32-4860-abcc-d6760460f6c7 req-b11471e4-36b5-4ebe-b8de-81d8ec830f56 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 944 time: 0.0778663
Jun 01 11:12:29.921286 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10700501'] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:29.934531 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d942ee2a-ff32-4860-abcc-d6760460f6c7 req-03159d8c-003a-41bb-a3ed-762a35850e02 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383127
Jun 01 11:12:29.980562 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.220378 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10700437', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-11313305'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.225253 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-364a5d16-ae5f-4316-9292-ecf102a7b9af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:30.262205 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1dfa662b-3182-4cf1-aa42-e313e271a7a1,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:30.265267 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:30.266240 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.276807 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/1dfa662b-3182-4cf1-aa42-e313e271a7a1 HTTP/1.1" status: 204  len: 168 time: 0.4667521
Jun 01 11:12:30.279541 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34952) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:30.357884 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b158a37-6bc9-4792-96a2-8d1e33059647 req-bda993a7-c439-444c-97cc-e408af05acff tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:30.359348 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3b158a37-6bc9-4792-96a2-8d1e33059647 req-bda993a7-c439-444c-97cc-e408af05acff tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0867074
Jun 01 11:12:30.383564 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.404833 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3b158a37-6bc9-4792-96a2-8d1e33059647 req-5ab851fc-bee8-49b3-a6c5-68bb0395a126 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395741
Jun 01 11:12:30.567003 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.579707 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f5792b9f040>,) {'filters': {'network_id': ['7642d4f7-83cf-45f3-b430-803385a99096']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:30.591814 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f5792b9f040>, '50169f53-532c-4126-a49b-bd813455458e') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:30.592104 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f5792b9f040>, '50169f53-532c-4126-a49b-bd813455458e') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:30.603022 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.618037 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.623789 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Releasing vlan 681 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:12:30.624162 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:12:30.637389 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:12:30.647072 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device f413cb23-a18e-4d8d-ab19-6cd2b065bc6f up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:12:30.712696 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.717242 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:30.722169 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:12:30.726910 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:12:30.727289 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.730589 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.740487 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Pushing event deleted for resources: {'Network': ['ID=7642d4f7-83cf-45f3-b430-803385a99096,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:30.743463 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:30.749847 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-ad6a49ca-28bc-4a4d-b28d-f1f5bd5d9efd admin admin] 10.222.0.74 "DELETE /v2.0/networks/7642d4f7-83cf-45f3-b430-803385a99096 HTTP/1.1" status: 204  len: 168 time: 0.4693477
Jun 01 11:12:30.847439 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.876469 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:12:30.878997 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-601b335e-ddb8-4331-b1c5-dfbba28ae888" -d '{"events": [{"server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "name": "network-vif-plugged", "status": "completed", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:12:30.888013 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:30.892439 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:30.894149 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 9f011433-de88-40d6-a527-c916faeb6339 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:12:30.926292 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-27928898-ebc2-4603-bea1-9d50c31dcd9c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:30.948833 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34964) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:30.972164 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:12:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf5a4ceb-1fba-4ce6-b52e-a6c8dc3939ee x-openstack-request-id: req-cf5a4ceb-1fba-4ce6-b52e-a6c8dc3939ee {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:12:30.972463 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "name": "network-vif-plugged", "status": "completed", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:12:30.972732 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-cf5a4ceb-1fba-4ce6-b52e-a6c8dc3939ee {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:12:30.973895 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'code': 200}
Jun 01 11:12:30.981294 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 9f011433-de88-40d6-a527-c916faeb6339 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:12:30.981644 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 9f011433-de88-40d6-a527-c916faeb6339 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:12:31.011868 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f599b3-4c36-4c5f-9cb6-d678e770592a req-61204479-0c06-49b5-8e6f-c255d55efb73 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:31.013328 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:31.013969 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f4f599b3-4c36-4c5f-9cb6-d678e770592a req-61204479-0c06-49b5-8e6f-c255d55efb73 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0911334
Jun 01 11:12:31.017464 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:31.025980 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-fb3adfd7-7b0c-4eae-9448-c17ff26a0e49 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=7bae65d9f7e14bd9a5a972ca94d43c3d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0752294
Jun 01 11:12:31.028350 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 34970) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:31.073474 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f4f599b3-4c36-4c5f-9cb6-d678e770592a req-8041d55b-99e9-4001-909a-42e39defd6bf tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528414
Jun 01 11:12:31.092234 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a9d0a194-7432-4c97-aac8-0230bbfc37a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:31.124080 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a9d0a194-7432-4c97-aac8-0230bbfc37a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:31.177050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a9d0a194-7432-4c97-aac8-0230bbfc37a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:31.181783 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-de86c6ff-170c-4ba4-a39a-fad01e35ce4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:31.195493 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d0a194-7432-4c97-aac8-0230bbfc37a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:31.198147 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a9d0a194-7432-4c97-aac8-0230bbfc37a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:31.203557 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a9d0a194-7432-4c97-aac8-0230bbfc37a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:31.204854 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-a9d0a194-7432-4c97-aac8-0230bbfc37a9 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/1d4ed099-f9e8-4e0a-8102-be1ee93ad2a4 HTTP/1.1" status: 204  len: 168 time: 0.1754119
Jun 01 11:12:31.239300 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f4e4b8-6df9-423a-9fc2-0b78969fbac8 req-d1028dc1-1b20-49d9-9b57-83c610d85455 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:31.240995 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c3f4e4b8-6df9-423a-9fc2-0b78969fbac8 req-d1028dc1-1b20-49d9-9b57-83c610d85455 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.1388068
Jun 01 11:12:31.265277 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3baba7b-ce96-421b-880d-89620b56b98b req-fbfb550e-ec71-4c96-9dd2-c542ee626c5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:31.266597 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c3baba7b-ce96-421b-880d-89620b56b98b req-fbfb550e-ec71-4c96-9dd2-c542ee626c5e service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1098 time: 0.1112702
Jun 01 11:12:31.318705 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c3f4e4b8-6df9-423a-9fc2-0b78969fbac8 req-e25a55ed-e688-48d1-9e38-dfcfaa42ca6e tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0691931
Jun 01 11:12:31.326785 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c3baba7b-ce96-421b-880d-89620b56b98b req-d86ff4d2-4858-4f9c-9123-a56580ca64cf service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0527389
Jun 01 11:12:31.602042 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835d8e64-89e1-4bdf-acd9-ebdd7142aafb req-64526b5e-b0df-4138-ae1e-3b7e8a9f1d98 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:31.603486 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-835d8e64-89e1-4bdf-acd9-ebdd7142aafb req-64526b5e-b0df-4138-ae1e-3b7e8a9f1d98 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0794096
Jun 01 11:12:31.652438 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-835d8e64-89e1-4bdf-acd9-ebdd7142aafb req-fd8742b9-4497-49de-989a-6a826cf6a6a4 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0431435
Jun 01 11:12:32.260448 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a734a48-2a35-46c0-ae92-5f4c2fca36ca req-fc0c3ce1-2f30-46df-8598-b2beb206a398 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:32.261801 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0a734a48-2a35-46c0-ae92-5f4c2fca36ca req-fc0c3ce1-2f30-46df-8598-b2beb206a398 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0817122
Jun 01 11:12:32.310333 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0a734a48-2a35-46c0-ae92-5f4c2fca36ca req-d778a8f7-f332-4e09-b567-7d9d6e35c6ae tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429502
Jun 01 11:12:32.507326 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9c4a628-8e7a-474b-8f26-463ce6dc794b req-3052aa52-793c-4f7c-b7e3-d1b01b65b5c9 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:32.508820 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b9c4a628-8e7a-474b-8f26-463ce6dc794b req-3052aa52-793c-4f7c-b7e3-d1b01b65b5c9 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.0824325
Jun 01 11:12:32.558989 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b9c4a628-8e7a-474b-8f26-463ce6dc794b req-9bc28054-bf88-4b4e-ae76-a44d0edc9d32 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434537
Jun 01 11:12:32.750455 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea39aedd-4e17-4a30-aba6-09a6a9027037 req-a994cb0f-d7a3-4276-a9fa-12206eff0687 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:32.752182 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ea39aedd-4e17-4a30-aba6-09a6a9027037 req-a994cb0f-d7a3-4276-a9fa-12206eff0687 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.0893326
Jun 01 11:12:32.805277 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:12:32.854213 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ea39aedd-4e17-4a30-aba6-09a6a9027037 req-dc73205b-29bc-4df3-925c-c193b4c67401 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0952144
Jun 01 11:12:32.896651 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ddcd0a-041b-4a4d-aa52-000dcbc2256b req-cf310f26-e5f7-4a82-957e-2d4b58c81c0b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:32.898121 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-00ddcd0a-041b-4a4d-aa52-000dcbc2256b req-cf310f26-e5f7-4a82-957e-2d4b58c81c0b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1110358
Jun 01 11:12:32.964262 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-00ddcd0a-041b-4a4d-aa52-000dcbc2256b req-8109ca3c-d271-44c7-ad53-103f4966bf21 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0555406
Jun 01 11:12:33.380055 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-a7f29a00-df77-4ed6-b2a3-85bc1d289393 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:33.381531 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-a7f29a00-df77-4ed6-b2a3-85bc1d289393 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e&tenant_id=c004520781bb4854b87284b73cc2a8be HTTP/1.1" status: 200  len: 1096 time: 0.1581211
Jun 01 11:12:33.393596 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f60c62af-f2c1-44e0-afdb-c2414257d57f req-594a7324-34e0-4415-9335-ca9a8c47d767 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:33.395047 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f60c62af-f2c1-44e0-afdb-c2414257d57f req-594a7324-34e0-4415-9335-ca9a8c47d767 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.0996783
Jun 01 11:12:33.545434 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f60c62af-f2c1-44e0-afdb-c2414257d57f req-b409f9c9-5203-4b0a-a19a-7da0e2553565 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1448715
Jun 01 11:12:33.572361 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-7685fdc5-7aba-4c03-968b-e68aaa3053a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:33.573870 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-7685fdc5-7aba-4c03-968b-e68aaa3053a0 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 1096 time: 0.1601233
Jun 01 11:12:33.585374 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab74971e-8127-4c6d-b077-17a1d30ea504 req-6e1b4a22-ad69-4794-8bdb-cef99becbf54 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:33.586939 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ab74971e-8127-4c6d-b077-17a1d30ea504 req-6e1b4a22-ad69-4794-8bdb-cef99becbf54 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.1375530
Jun 01 11:12:33.635329 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ab74971e-8127-4c6d-b077-17a1d30ea504 req-dac0f1eb-a38e-49aa-9c67-cf7363c47cc8 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396404
Jun 01 11:12:34.152487 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c04f9f90-a445-4662-9b72-0531637c8f16 req-d573a5cd-613d-4b45-86b8-7e97d1ea0a11 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:34.153950 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c04f9f90-a445-4662-9b72-0531637c8f16 req-d573a5cd-613d-4b45-86b8-7e97d1ea0a11 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0828059
Jun 01 11:12:34.198175 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c04f9f90-a445-4662-9b72-0531637c8f16 req-37db52fc-a243-4dfd-93ac-479ef16c89ff tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0378008
Jun 01 11:12:34.818351 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd18680b-59c9-4720-aee9-7f4df950d31a req-2f785cfe-e078-47a9-b914-8be55949e4e2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:34.819839 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd18680b-59c9-4720-aee9-7f4df950d31a req-2f785cfe-e078-47a9-b914-8be55949e4e2 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0817869
Jun 01 11:12:34.865227 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd18680b-59c9-4720-aee9-7f4df950d31a req-55ac56f2-f961-4b75-aca8-819c3c9de307 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390627
Jun 01 11:12:35.515999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-5696fde0-6595-4d3c-ab89-91ea4931881d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:35.517483 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-5696fde0-6595-4d3c-ab89-91ea4931881d service neutron] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 917 time: 0.2681830
Jun 01 11:12:35.533584 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1aec31-95a6-4a5e-b012-4ec44821cd48 req-693320f2-9a15-401a-aed2-f330e0bf6b03 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:35.535087 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5d1aec31-95a6-4a5e-b012-4ec44821cd48 req-693320f2-9a15-401a-aed2-f330e0bf6b03 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1344769
Jun 01 11:12:35.582705 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5d1aec31-95a6-4a5e-b012-4ec44821cd48 req-6036e027-abc3-4b27-ac61-e1681bb5f445 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381935
Jun 01 11:12:36.051245 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30a4002-a608-48fb-a31c-d0635b31bdac req-24cc80dc-42fd-4474-a2ef-2e650b643e35 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:36.052719 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a30a4002-a608-48fb-a31c-d0635b31bdac req-24cc80dc-42fd-4474-a2ef-2e650b643e35 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0809472
Jun 01 11:12:36.097110 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a30a4002-a608-48fb-a31c-d0635b31bdac req-fbea4df6-b468-4783-99a7-f3a998c46b56 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382817
Jun 01 11:12:36.380993 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-48dd861f-9f04-4370-b555-e65d321935c0 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=6c613458-8891-4e54-aa10-4a7743587916 HTTP/1.1" status: 200  len: 999 time: 0.0979958
Jun 01 11:12:36.445069 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-45c57c47-9f5b-410c-839b-2e71e1db2651 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:36.446495 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-45c57c47-9f5b-410c-839b-2e71e1db2651 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.0563595
Jun 01 11:12:36.522369 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-7c8fae2e-2e2a-45f3-8e95-09d0d16c86f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:36.523886 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-7c8fae2e-2e2a-45f3-8e95-09d0d16c86f0 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0685680
Jun 01 11:12:36.673512 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-6d85812e-bc3d-4912-a395-668172e9b3fb service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1383815
Jun 01 11:12:36.866758 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b371c4e-f1a7-4953-ab48-6065efa132b4 req-07630a50-427d-4c73-a99f-be28b9b4b906 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1859243
Jun 01 11:12:36.878279 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c755576-d846-47b4-8ac5-b07a8d771476 req-f5c9298d-43a5-4a24-a2d6-bf4c5055bb37 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:36.879866 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4c755576-d846-47b4-8ac5-b07a8d771476 req-f5c9298d-43a5-4a24-a2d6-bf4c5055bb37 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1754403
Jun 01 11:12:36.925985 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4c755576-d846-47b4-8ac5-b07a8d771476 req-b9c143bc-3c4e-45b0-af9d-3a865ec74442 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394492
Jun 01 11:12:37.023515 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-cf87465d-7837-48cb-b18f-e742f7b4011f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:37.024982 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-cf87465d-7837-48cb-b18f-e742f7b4011f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.79 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.0905106
Jun 01 11:12:37.161883 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Deleting port b697fc18-c717-4cd5-a5ec-3378e1131e24 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:12:37.162228 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:37.362716 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] For port b697fc18-c717-4cd5-a5ec-3378e1131e24, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b697fc18-c717-4cd5-a5ec-3378e1131e24,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:37.363072 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:37.546510 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Calling delete_port for b697fc18-c717-4cd5-a5ec-3378e1131e24 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:12:37.560238 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd6d0de-5f6f-420f-99f6-888064333912 req-8a3d7c50-4b58-46d4-905b-ce0b270e38b3 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:37.561594 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6bd6d0de-5f6f-420f-99f6-888064333912 req-8a3d7c50-4b58-46d4-905b-ce0b270e38b3 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 946 time: 0.3248768
Jun 01 11:12:37.800161 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6bd6d0de-5f6f-420f-99f6-888064333912 req-afa71994-4fe9-47f4-b9cb-3eae8456119f tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/security-groups?id=92b41362-5e38-456f-a9ce-05c3b0c3b3ad&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2246881
Jun 01 11:12:37.945888 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:37.958263 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['b697fc18-c717-4cd5-a5ec-3378e1131e24'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:12:37.963167 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a1378ed4-e9f2-4e01-90ab-503569066b00 tempest-VolumesNegativeTest-537871651 tempest-VolumesNegativeTest-537871651-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:38.136432 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Pushing event deleted for resources: {'Port': ['ID=b697fc18-c717-4cd5-a5ec-3378e1131e24,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:38.146640 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:38.204248 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] No DVR routers for this DVR port b697fc18-c717-4cd5-a5ec-3378e1131e24 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:12:38.211377 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:38.215597 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ae35c17-2544-4168-bce0-4d60d97a1698', 'name': 'network-vif-deleted', 'tag': 'b697fc18-c717-4cd5-a5ec-3378e1131e24'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:12:38.218726 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7e536b50-9a94-4c04-883a-0eb8962c0c20" -d '{"events": [{"server_uuid": "2ae35c17-2544-4168-bce0-4d60d97a1698", "name": "network-vif-deleted", "tag": "b697fc18-c717-4cd5-a5ec-3378e1131e24"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:12:38.236829 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-66fde48a-bf55-4643-a72b-e31bb3d668f0 req-99ae6d12-2432-4af3-b7f2-77221fb6ef63 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.79 "DELETE /v2.0/ports/b697fc18-c717-4cd5-a5ec-3378e1131e24 HTTP/1.1" status: 204  len: 173 time: 1.2059348
Jun 01 11:12:38.357500 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-812a4fd1-7187-4a50-85ef-357603919b09 req-ea0ae382-d227-4598-9097-c650bd8d1b43 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:38.359016 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-812a4fd1-7187-4a50-85ef-357603919b09 req-ea0ae382-d227-4598-9097-c650bd8d1b43 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1037216
Jun 01 11:12:38.407978 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-812a4fd1-7187-4a50-85ef-357603919b09 req-af84eded-57de-42d4-b744-78fbe633a764 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0430036
Jun 01 11:12:38.595166 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-799a5605-cbf3-4a42-89e7-57633a9b1cde req-a5ae1c37-7c76-49fe-a2d1-f7844a65f17e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:38.596688 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-799a5605-cbf3-4a42-89e7-57633a9b1cde req-a5ae1c37-7c76-49fe-a2d1-f7844a65f17e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0898786
Jun 01 11:12:38.647989 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-799a5605-cbf3-4a42-89e7-57633a9b1cde req-018ac07f-f1c8-4f36-8d16-06c9ed91e4f3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451117
Jun 01 11:12:38.701479 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:12:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-191185f0-6aa5-4b4f-98fe-e80290331d5c x-openstack-request-id: req-191185f0-6aa5-4b4f-98fe-e80290331d5c {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:12:38.701806 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ae35c17-2544-4168-bce0-4d60d97a1698", "name": "network-vif-deleted", "tag": "b697fc18-c717-4cd5-a5ec-3378e1131e24", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:12:38.702265 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-191185f0-6aa5-4b4f-98fe-e80290331d5c {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:12:38.702700 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ae35c17-2544-4168-bce0-4d60d97a1698', 'name': 'network-vif-deleted', 'tag': 'b697fc18-c717-4cd5-a5ec-3378e1131e24', 'status': 'completed', 'code': 200}
Jun 01 11:12:38.983810 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-36fd539c-d19f-44cd-933a-646fcc2d24ef req-a4b27603-4050-4e9e-8667-b8d75c37434c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Synchronizing usage tracker for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:12:39.002215 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-36fd539c-d19f-44cd-933a-646fcc2d24ef req-a4b27603-4050-4e9e-8667-b8d75c37434c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Unset dirty status for tenant:aac1cb46a9b144f5a5fac5f5c98fed2b on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:12:39.003526 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-36fd539c-d19f-44cd-933a-646fcc2d24ef req-a4b27603-4050-4e9e-8667-b8d75c37434c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0675445
Jun 01 11:12:39.613213 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15de09ee-48b6-4835-9fbd-9fdbd8918c8c req-5560555c-1808-4fc9-9fa2-4f6e102c213b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:39.614663 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-15de09ee-48b6-4835-9fbd-9fdbd8918c8c req-5560555c-1808-4fc9-9fa2-4f6e102c213b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0911219
Jun 01 11:12:39.665750 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-15de09ee-48b6-4835-9fbd-9fdbd8918c8c req-5eb84a0c-ec05-4a7e-be8d-2a955f207040 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0445597
Jun 01 11:12:39.856771 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506ea873-f7b4-4c10-9faa-aff7df5c53aa req-4fba9976-604c-4df9-81b8-c5354a08dc7c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:39.858235 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-506ea873-f7b4-4c10-9faa-aff7df5c53aa req-4fba9976-604c-4df9-81b8-c5354a08dc7c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0850885
Jun 01 11:12:39.908533 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-506ea873-f7b4-4c10-9faa-aff7df5c53aa req-d7498f11-3923-4e3a-a442-c4e31332074d tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0443015
Jun 01 11:12:40.159964 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-985f13df-7f20-4b09-a106-c665343ec40a req-be1eb077-b7db-4b99-96a7-96f3cc051a65 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0427244
Jun 01 11:12:40.866763 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfcfdfe1-6d40-442a-b079-8059963cf63c req-41bb6bf7-40d6-44f1-99f3-bce51ec4a8d8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:40.868370 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cfcfdfe1-6d40-442a-b079-8059963cf63c req-41bb6bf7-40d6-44f1-99f3-bce51ec4a8d8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0841906
Jun 01 11:12:40.921020 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cfcfdfe1-6d40-442a-b079-8059963cf63c req-eda3cb29-50c3-4bc8-a043-649a789e6e2c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0470500
Jun 01 11:12:41.114459 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9480311d-067b-43b2-8068-2508b1f42448 req-0b9e4e4e-a86c-47f6-91b3-57d181cb6628 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:41.116097 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9480311d-067b-43b2-8068-2508b1f42448 req-0b9e4e4e-a86c-47f6-91b3-57d181cb6628 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0850012
Jun 01 11:12:41.160897 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9480311d-067b-43b2-8068-2508b1f42448 req-acc63e46-3381-4f2c-af36-c394c3c326d7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383766
Jun 01 11:12:41.337499 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-19305e1f-dc84-4fe3-aeb3-ce90ccf7d823 req-0641755b-bb06-4e3a-997c-34ae2a352fdd tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0660436
Jun 01 11:12:42.085049 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device b697fc18-c717-4cd5-a5ec-3378e1131e24 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:12:42.133024 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: b697fc18-c717-4cd5-a5ec-3378e1131e24 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:12:42.133507 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device b697fc18-c717-4cd5-a5ec-3378e1131e24 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:12:42.148516 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e8bbbd-be7b-445a-b6fa-94e030c5ec97 req-a91dc197-097f-48bd-99c4-d529d7608b9b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:42.150051 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-92e8bbbd-be7b-445a-b6fa-94e030c5ec97 req-a91dc197-097f-48bd-99c4-d529d7608b9b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.1117618
Jun 01 11:12:42.211176 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-92e8bbbd-be7b-445a-b6fa-94e030c5ec97 req-75791606-be18-468c-8443-3ba1248fcaa5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0539448
Jun 01 11:12:42.414960 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1a06b2-9315-4de4-a1f5-02a33d76ffd2 req-980a998e-8eb2-4d16-add7-54ccb267007e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:42.416465 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ec1a06b2-9315-4de4-a1f5-02a33d76ffd2 req-980a998e-8eb2-4d16-add7-54ccb267007e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0915711
Jun 01 11:12:42.461075 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ec1a06b2-9315-4de4-a1f5-02a33d76ffd2 req-a8b669e3-f316-41ec-b490-38901f405e76 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390375
Jun 01 11:12:42.600115 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c9dea3ff-59cc-4fda-8416-d9be33761976 req-a180058d-a830-41da-a55b-709171111b6e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0426195
Jun 01 11:12:43.408568 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fbae47-a856-4574-901e-e173e43b64ae req-551fa4af-a82f-43f4-929c-a26970592d75 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:43.410055 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a5fbae47-a856-4574-901e-e173e43b64ae req-551fa4af-a82f-43f4-929c-a26970592d75 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0899472
Jun 01 11:12:43.460116 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a5fbae47-a856-4574-901e-e173e43b64ae req-b7d1d203-3335-48c9-9f27-316cc8db1249 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0431774
Jun 01 11:12:43.658381 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e434ee4-a8aa-4586-8d15-07e248f91f06 req-1a8ee3b7-9be0-49cb-a12d-bb95e45dc8d9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:43.659908 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e434ee4-a8aa-4586-8d15-07e248f91f06 req-1a8ee3b7-9be0-49cb-a12d-bb95e45dc8d9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0881591
Jun 01 11:12:43.710298 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e434ee4-a8aa-4586-8d15-07e248f91f06 req-86e7ef80-c686-4b13-9321-8d97ac95749e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0446539
Jun 01 11:12:43.855945 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d9890733-57b3-4ace-a373-108ee395333d req-bf131bb1-eed2-4650-9128-e60c21d89992 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0459013
Jun 01 11:12:44.655477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230f0d84-fa23-4d42-8cfe-1bde5521572c req-d0aac892-7c0a-46d9-b8e1-1a47075137f1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:44.656946 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-230f0d84-fa23-4d42-8cfe-1bde5521572c req-d0aac892-7c0a-46d9-b8e1-1a47075137f1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0814941
Jun 01 11:12:44.705431 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-230f0d84-fa23-4d42-8cfe-1bde5521572c req-8dbbb67b-2ec4-4537-a63d-05012dcb5a85 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426445
Jun 01 11:12:44.902316 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5388bb3-0308-4234-8a60-0caf5e6ab6cf req-473a2317-497a-47b7-8a83-ec8e8d27f75e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:44.904409 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c5388bb3-0308-4234-8a60-0caf5e6ab6cf req-473a2317-497a-47b7-8a83-ec8e8d27f75e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0891936
Jun 01 11:12:44.951091 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c5388bb3-0308-4234-8a60-0caf5e6ab6cf req-73bdf261-00ca-435c-a150-cf4ee2343481 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409188
Jun 01 11:12:45.097491 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-553b68a8-ed24-4764-8fdc-8bb928c12059 req-30394a90-332e-4f02-a43f-0004b43a31c6 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0436108
Jun 01 11:12:45.895420 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c42101c-e829-45e8-a8b7-5a437efb0c3a req-4be79be2-b142-435e-a1f7-2e3cf87ec1e1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:45.896904 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8c42101c-e829-45e8-a8b7-5a437efb0c3a req-4be79be2-b142-435e-a1f7-2e3cf87ec1e1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0823867
Jun 01 11:12:46.027416 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8c42101c-e829-45e8-a8b7-5a437efb0c3a req-3492cab9-8e5a-42f0-9e8e-b5a866e29e34 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1243892
Jun 01 11:12:46.214019 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea4bf7f-4416-4c53-9510-c8b7e390142d req-8d710110-636a-4a65-82f4-1e5f78bea6c7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:46.215497 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6ea4bf7f-4416-4c53-9510-c8b7e390142d req-8d710110-636a-4a65-82f4-1e5f78bea6c7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0876465
Jun 01 11:12:46.263063 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6ea4bf7f-4416-4c53-9510-c8b7e390142d req-2054d935-b038-41cb-bae2-b1410906e7fc tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419114
Jun 01 11:12:46.410141 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a3aec38-d09d-4014-aadc-c602fdc372d6 req-ba96d4d1-3de4-4d6d-8a0d-8b28e7524e9c tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0454252
Jun 01 11:12:46.583965 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:47.229566 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b173ae18-4e50-45f0-9e79-7b066896544f req-d45cdbad-e66b-4516-9c1d-5c6c6ce16b37 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:47.231050 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b173ae18-4e50-45f0-9e79-7b066896544f req-d45cdbad-e66b-4516-9c1d-5c6c6ce16b37 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0931118
Jun 01 11:12:47.281610 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b173ae18-4e50-45f0-9e79-7b066896544f req-a9e9d091-d2a2-4598-864b-64056f887929 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0437653
Jun 01 11:12:47.463882 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0b671d-bb33-4749-9bdc-9279b875e15e req-999ef3ee-8fcb-40f9-89ca-5288571bcc2b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:47.465331 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8e0b671d-bb33-4749-9bdc-9279b875e15e req-999ef3ee-8fcb-40f9-89ca-5288571bcc2b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0853276
Jun 01 11:12:47.514094 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8e0b671d-bb33-4749-9bdc-9279b875e15e req-fb2fdff1-c198-44d5-a966-632c3fdaa956 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426395
Jun 01 11:12:47.657036 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5eac10a2-b72b-44db-8a04-e537d8608666 req-3ea05c12-0d7e-4960-847f-697d773ea9a3 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0432441
Jun 01 11:12:48.477789 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbe0238-b260-4848-8dc7-7e048ab64714 req-be29900a-0214-4efc-be99-c4008bad39f9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:48.479877 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5bbe0238-b260-4848-8dc7-7e048ab64714 req-be29900a-0214-4efc-be99-c4008bad39f9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0867145
Jun 01 11:12:48.524320 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5bbe0238-b260-4848-8dc7-7e048ab64714 req-5c085dd4-692e-4fc4-8431-fc7f8d2442f5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386572
Jun 01 11:12:48.699403 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff8cf459-66a0-4587-9317-a4ea6636aacc req-b352607b-e35d-4703-8dfb-15768bb7f3ae tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:48.700964 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ff8cf459-66a0-4587-9317-a4ea6636aacc req-b352607b-e35d-4703-8dfb-15768bb7f3ae tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0798578
Jun 01 11:12:48.746840 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ff8cf459-66a0-4587-9317-a4ea6636aacc req-cd141368-d405-494f-8fc2-23743a57b37b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399606
Jun 01 11:12:48.886262 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-252d57aa-51d3-4dae-83f4-7f4dde61fa6a req-d654190f-8be0-4dff-a2b7-98b66e4794d1 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] 10.222.0.74 "GET /v2.0/ports?device_id=2ae35c17-2544-4168-bce0-4d60d97a1698 HTTP/1.1" status: 200  len: 210 time: 0.0467229
Jun 01 11:12:49.725907 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09c48df0-6c50-432e-a59e-ce0362848b66 req-1e801e78-0060-4b9e-8e83-01297cca0b01 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:49.727378 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-09c48df0-6c50-432e-a59e-ce0362848b66 req-1e801e78-0060-4b9e-8e83-01297cca0b01 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0845056
Jun 01 11:12:49.778735 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-09c48df0-6c50-432e-a59e-ce0362848b66 req-cf0773a6-7d8f-41b7-9e09-9e137d12bdaf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0437660
Jun 01 11:12:49.944347 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a312eb6-5ddd-4ad8-b75e-96b074126509 req-4c6264d3-3c4f-40fd-bc56-dd53388c2877 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:49.945907 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5a312eb6-5ddd-4ad8-b75e-96b074126509 req-4c6264d3-3c4f-40fd-bc56-dd53388c2877 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0927141
Jun 01 11:12:49.982817 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35198) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:49.996785 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5a312eb6-5ddd-4ad8-b75e-96b074126509 req-f0884574-6d5a-4561-9328-bc09bfc825af tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437407
Jun 01 11:12:50.534623 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-926124'] for router_interface, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:50.938014 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Deleting port 797df9ad-f50f-4533-9c1f-65512bddf40a {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:12:50.938361 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:50.975103 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84973a35-59eb-457a-835a-4a2db6b00537 req-9693bcc3-6ee1-43de-bb72-35980c21b2e2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:50.976579 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-84973a35-59eb-457a-835a-4a2db6b00537 req-9693bcc3-6ee1-43de-bb72-35980c21b2e2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0822651
Jun 01 11:12:51.022864 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-84973a35-59eb-457a-835a-4a2db6b00537 req-1591df30-79be-4642-b551-d3e649258530 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404537
Jun 01 11:12:51.062699 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] For port 797df9ad-f50f-4533-9c1f-65512bddf40a, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=797df9ad-f50f-4533-9c1f-65512bddf40a,segment=NetworkSegment(282c4d7b-9de4-4e04-b767-7c3bddb71626),segment_id=282c4d7b-9de4-4e04-b767-7c3bddb71626)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:51.063276 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:51.190445 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac87a7f-ffd7-4161-a632-d0ddccdcd5cc req-ac5ff2a6-a74a-4757-86a7-59be11c285ae tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:51.192035 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4ac87a7f-ffd7-4161-a632-d0ddccdcd5cc req-ac5ff2a6-a74a-4757-86a7-59be11c285ae tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0879347
Jun 01 11:12:51.237283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4ac87a7f-ffd7-4161-a632-d0ddccdcd5cc req-002fd43c-872b-4a77-b245-25cdbc014f8b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389190
Jun 01 11:12:51.257553 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Calling delete_port for 797df9ad-f50f-4533-9c1f-65512bddf40a owned by network:router_interface {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:12:51.537769 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:51.543015 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:51.610693 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Pushing event deleted for resources: {'Port': ['ID=797df9ad-f50f-4533-9c1f-65512bddf40a,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:51.629251 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.629615 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.629970 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.630314 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.630658 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.630998 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.631337 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.631715 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.632145 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.632405 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.632738 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.633065 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:51.665545 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:51.861621 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-776947', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-646716'] for router_interface, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:52.209209 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e1747a-e210-4bfc-8483-00d686e39b6f req-fb7dfa34-0e56-4f1e-9f58-7659ca60c5a9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:52.210666 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-31e1747a-e210-4bfc-8483-00d686e39b6f req-fb7dfa34-0e56-4f1e-9f58-7659ca60c5a9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0801506
Jun 01 11:12:52.213459 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Router 51d6b52d-91aa-469c-9023-bb7143053ec7 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:12:52.260491 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-31e1747a-e210-4bfc-8483-00d686e39b6f req-7722c99c-0709-49ef-ba2e-b144feac081e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441494
Jun 01 11:12:52.396029 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:12:52.404822 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] Sync routers for ids ['51d6b52d-91aa-469c-9023-bb7143053ec7'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:12:52.414419 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] 10.222.0.74 "PUT /v2.0/routers/51d6b52d-91aa-469c-9023-bb7143053ec7/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4297585
Jun 01 11:12:52.414918 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] Routers {'51d6b52d-91aa-469c-9023-bb7143053ec7'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:12:52.415530 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57985eb670>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:12:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['51d6b52d-91aa-469c-9023-bb7143053ec7'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:52.417364 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35226) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:52.436693 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4405490-77a4-4401-a538-6a7c8d2d80a4 req-bd5758d6-128c-4751-9054-a6320fae9888 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:52.439026 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a4405490-77a4-4401-a538-6a7c8d2d80a4 req-bd5758d6-128c-4751-9054-a6320fae9888 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0904441
Jun 01 11:12:52.488568 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a4405490-77a4-4401-a538-6a7c8d2d80a4 req-58a0bc8c-8ec9-4d5e-a40d-b22028f206cf tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0446854
Jun 01 11:12:52.603623 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] Set router 51d6b52d-91aa-469c-9023-bb7143053ec7 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:12:52.693355 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks [] for router, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:52.698951 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-212fa404-5820-4c42-8737-1e9c39768fff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:52.868036 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:52.887282 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57985eb670>, [{'id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251'}], 'enable_snat': True}, 'gw_port_id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:12:51Z', 'revision_number': 5, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'gw_port': {'id': '719565de-9fb7-4dd5-8529-d1ff8b32a498', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:6f:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:53Z', 'updated_at': '2021-06-01T11:09:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:52.891403 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] Checking router: 51d6b52d-91aa-469c-9023-bb7143053ec7 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:12:52.899744 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] Routers {'51d6b52d-91aa-469c-9023-bb7143053ec7'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:12:52.900974 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57985eb670>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:12:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['51d6b52d-91aa-469c-9023-bb7143053ec7'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:52.937501 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Deleting port 719565de-9fb7-4dd5-8529-d1ff8b32a498 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:12:52.937835 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.059233 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] For port 719565de-9fb7-4dd5-8529-d1ff8b32a498, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=719565de-9fb7-4dd5-8529-d1ff8b32a498,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:53.059575 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.082833 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] Set router 51d6b52d-91aa-469c-9023-bb7143053ec7 gateway port host: None {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:12:53.183162 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Calling delete_port for 719565de-9fb7-4dd5-8529-d1ff8b32a498 owned by network:router_gateway {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:12:53.187030 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57985eb670>, [{'id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:12:52Z', 'revision_number': 6, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'gw_port_host': None}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:53.190168 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-327b3b7c-8151-4256-8447-e255ccdaa6e2 None None] The sync data for ids ['51d6b52d-91aa-469c-9023-bb7143053ec7'] in dv-cinder-787764-3-iscsi is: [{'id': '51d6b52d-91aa-469c-9023-bb7143053ec7', 'name': 'tempest-ServerRescueNegativeTestJSON-802073209-router', 'tenant_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:12:52Z', 'revision_number': 6, 'project_id': 'aac1cb46a9b144f5a5fac5f5c98fed2b', 'gw_port_host': None}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:12:53.323287 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.328383 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:53.374438 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Pushing event deleted for resources: {'Port': ['ID=719565de-9fb7-4dd5-8529-d1ff8b32a498,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:53.400379 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:53.462161 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de59aa5-1a2d-4d52-aa8f-2412156266a5 req-d09ecc16-9ff2-410a-8090-37432d68cfb2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:53.463328 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-645297'] for router_gateway, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.464177 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3de59aa5-1a2d-4d52-aa8f-2412156266a5 req-d09ecc16-9ff2-410a-8090-37432d68cfb2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0852168
Jun 01 11:12:53.509566 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3de59aa5-1a2d-4d52-aa8f-2412156266a5 req-e069b7e2-5a11-4c45-84e5-753f16f1fd17 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0392375
Jun 01 11:12:53.635814 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-643132', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4050'] for router, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.638049 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.698035 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e90e59c-3393-4463-adce-31eedeb5e80e req-6c2c74de-b628-48a9-b6b1-140534d0885b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:53.700047 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5e90e59c-3393-4463-adce-31eedeb5e80e req-6c2c74de-b628-48a9-b6b1-140534d0885b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0963144
Jun 01 11:12:53.730430 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-643584'] for router, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.731558 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 51d6b52d-91aa-469c-9023-bb7143053ec7 {{(pid=119240) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 11:12:53.753284 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.754417 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] 10.222.0.74 "DELETE /v2.0/routers/51d6b52d-91aa-469c-9023-bb7143053ec7 HTTP/1.1" status: 204  len: 168 time: 1.3360732
Jun 01 11:12:53.756584 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5e90e59c-3393-4463-adce-31eedeb5e80e req-4618a73d-6aba-4890-8ed4-72b026d688ed tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0487955
Jun 01 11:12:53.757117 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 35242) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:53.820210 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_v2 [None req-d418c588-1cc4-4054-9f3b-4d04b5be1cce admin admin] Deleting subnet 069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 {{(pid=119241) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:12:53.823100 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d418c588-1cc4-4054-9f3b-4d04b5be1cce admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.871021 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d418c588-1cc4-4054-9f3b-4d04b5be1cce admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10844045'] for subnet, precommit_delete_associations {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:53.923645 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d418c588-1cc4-4054-9f3b-4d04b5be1cce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.245696 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d418c588-1cc4-4054-9f3b-4d04b5be1cce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10882836', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10623430'] for subnet, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.249852 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:54.283788 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d418c588-1cc4-4054-9f3b-4d04b5be1cce admin admin] Pushing event deleted for resources: {'Subnet': ['ID=069e04dd-9d3b-4ce0-997c-7cfc632b4fe3,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:54.286816 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d418c588-1cc4-4054-9f3b-4d04b5be1cce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:54.287795 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d418c588-1cc4-4054-9f3b-4d04b5be1cce admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.295035 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d418c588-1cc4-4054-9f3b-4d04b5be1cce admin admin] 10.222.0.74 "DELETE /v2.0/subnets/069e04dd-9d3b-4ce0-997c-7cfc632b4fe3 HTTP/1.1" status: 204  len: 168 time: 0.5354939
Jun 01 11:12:54.296837 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35246) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:54.369834 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 719565de-9fb7-4dd5-8529-d1ff8b32a498 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:12:54.405013 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 719565de-9fb7-4dd5-8529-d1ff8b32a498 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:12:54.405366 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 719565de-9fb7-4dd5-8529-d1ff8b32a498 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:12:54.405790 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 797df9ad-f50f-4533-9c1f-65512bddf40a no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:12:54.440406 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 797df9ad-f50f-4533-9c1f-65512bddf40a {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:12:54.440764 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 797df9ad-f50f-4533-9c1f-65512bddf40a not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:12:54.482627 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.604204 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.617296 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f5793e2dfd0>,) {'filters': {'network_id': ['e8c7dea7-722b-446b-9e9f-d27643e48187']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:54.629935 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f5793e2dfd0>, '282c4d7b-9de4-4e04-b767-7c3bddb71626') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:54.630231 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f5793e2dfd0>, '282c4d7b-9de4-4e04-b767-7c3bddb71626') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:54.641978 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.658258 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.664491 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Releasing vlan 693 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:12:54.664907 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:12:54.678583 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:12:54.721052 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eca5e48-194e-488d-b33b-fb7114308293 req-c6623829-a2ed-4632-bddc-0e6bc70f6f36 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:54.722500 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2eca5e48-194e-488d-b33b-fb7114308293 req-c6623829-a2ed-4632-bddc-0e6bc70f6f36 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0850184
Jun 01 11:12:54.755578 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.759494 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:54.768454 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2eca5e48-194e-488d-b33b-fb7114308293 req-140a6623-4594-49c4-87c9-bd507749bf41 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403163
Jun 01 11:12:54.772448 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:54.783183 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Pushing event deleted for resources: {'Network': ['ID=e8c7dea7-722b-446b-9e9f-d27643e48187,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:54.786550 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:54.803847 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] 10.222.0.74 "DELETE /v2.0/networks/e8c7dea7-722b-446b-9e9f-d27643e48187 HTTP/1.1" status: 204  len: 168 time: 0.5037196
Jun 01 11:12:54.952021 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4187ef9-dcb0-4349-a01b-a40bc2a1a1d5 req-17f94545-e502-49b2-88ea-caaa266ba3a3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:54.953560 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c4187ef9-dcb0-4349-a01b-a40bc2a1a1d5 req-17f94545-e502-49b2-88ea-caaa266ba3a3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0869913
Jun 01 11:12:55.009033 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35260) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:55.014049 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c4187ef9-dcb0-4349-a01b-a40bc2a1a1d5 req-0f02aea7-4303-47db-bc1b-c1567f04d147 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0544033
Jun 01 11:12:55.057790 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-709c5726-0197-4685-869b-1084519bb6f4 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=aac1cb46a9b144f5a5fac5f5c98fed2b&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0476224
Jun 01 11:12:55.060261 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35264) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:55.116687 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0886b929-3773-422c-ad01-76d44c626d31 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:55.141815 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0886b929-3773-422c-ad01-76d44c626d31 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:55.194733 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0886b929-3773-422c-ad01-76d44c626d31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:55.199814 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:55.212606 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0886b929-3773-422c-ad01-76d44c626d31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92b41362-5e38-456f-a9ce-05c3b0c3b3ad,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:55.215559 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0886b929-3773-422c-ad01-76d44c626d31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:55.223110 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0886b929-3773-422c-ad01-76d44c626d31 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:55.226926 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-0886b929-3773-422c-ad01-76d44c626d31 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/92b41362-5e38-456f-a9ce-05c3b0c3b3ad HTTP/1.1" status: 204  len: 168 time: 0.1656561
Jun 01 11:12:55.249437 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-13725671-ab0d-4a6e-a933-53b11ae17ed4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:55.312677 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:55.984123 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5396dc20-bd4b-4c22-a7e6-8b71164d56c8 req-4d168800-07cc-4708-b5b5-4e5d6967be0a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:55.986886 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5396dc20-bd4b-4c22-a7e6-8b71164d56c8 req-4d168800-07cc-4708-b5b5-4e5d6967be0a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 943 time: 0.0976400
Jun 01 11:12:56.022933 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35296) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:56.052484 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5396dc20-bd4b-4c22-a7e6-8b71164d56c8 req-0cbfa5fb-6ce9-4c26-8abf-9639d53f6a64 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0576940
Jun 01 11:12:56.136062 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:12:56.152970 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1236738845-network', 'tenant_id': 'a83ba65361364d0fad1aa55a0f8cb7cf'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:12:56.157942 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:12:56.175235 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Usage tracker for resource:network and tenant:a83ba65361364d0fad1aa55a0f8cb7cf is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:12:56.179071 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:12:56.189483 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:12:56.209529 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Made reservation on behalf of a83ba65361364d0fad1aa55a0f8cb7cf for: {'network': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:12:56.212383 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.232198 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.244739 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c1988e-b1b3-4221-ab1d-86fdc2677fc8 req-3c167eff-0282-4ea9-9010-8b3bb04f87d3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:56.244739 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e4c1988e-b1b3-4221-ab1d-86fdc2677fc8 req-3c167eff-0282-4ea9-9010-8b3bb04f87d3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1060927
Jun 01 11:12:56.254977 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:12:56.261121 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Usage tracker for resource:security_group_rule and tenant:a83ba65361364d0fad1aa55a0f8cb7cf is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:12:56.265083 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:12:56.272985 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:12:56.302870 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:56.312678 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e4c1988e-b1b3-4221-ab1d-86fdc2677fc8 req-d247d16b-638e-49e2-b1a2-45d53adc49e7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0631533
Jun 01 11:12:56.334884 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '6c613458-8891-4e54-aa10-4a7743587916', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'port_id': '6c613458-8891-4e54-aa10-4a7743587916', 'mac_address': 'fa:16:3e:c8:58:1c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:12:56.376407 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.380843 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.386035 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a9d0a194-7432-4c97-aac8-0230bbfc37a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:56.410795 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 682}  {{(pid=119240) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:12:56.424122 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a42d143-115c-4881-bea6-40275871966c,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:56.428166 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:56.429392 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.429805 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.segments_db [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Added segment 2030aac5-bed9-4a3d-aab1-8277fcd22311 of type vlan for network 10ec91f8-5d7c-496e-a32a-4dcea0b24793
Jun 01 11:12:56.438307 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.442390 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.457598 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.460291 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6c613458-8891-4e54-aa10-4a7743587916 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:12:56.476976 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:56.484209 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.486831 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-98459c68-a6b9-4c82-85ea-3e8ba0128414 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:56.490989 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.492347 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:56.492927 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.496372 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07079564-15e3-4986-814b-c49295642c1e req-2d8c3596-4c11-431b-ac32-a599dfd52773 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:56.496760 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:56.498092 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-07079564-15e3-4986-814b-c49295642c1e req-2d8c3596-4c11-431b-ac32-a599dfd52773 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.1160095
Jun 01 11:12:56.548635 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-07079564-15e3-4986-814b-c49295642c1e req-0665ce78-dae7-4e06-aff1-ad25d5f8a48d tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438941
Jun 01 11:12:56.577900 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 35308) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:56.578574 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=9']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:56.588108 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.588552 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.588961 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.589360 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.589804 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.590326 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.591501 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.592048 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.592453 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.592854 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.593261 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.593651 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:12:56.599177 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:56.608250 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.5839419
Jun 01 11:12:56.609098 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Pushing event updated for resources: {'Network': ['ID=10ec91f8-5d7c-496e-a32a-4dcea0b24793,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:56.611498 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 35314) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:56.611940 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:56.620653 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:12:56.621326 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Request body: {'subnet': {'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1236738845-subnet', 'tenant_id': 'a83ba65361364d0fad1aa55a0f8cb7cf', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:12:56.626669 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:12:56.630920 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Usage tracker for resource:subnet and tenant:a83ba65361364d0fad1aa55a0f8cb7cf is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:12:56.634105 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:12:56.642275 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:12:56.655421 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Made reservation on behalf of a83ba65361364d0fad1aa55a0f8cb7cf for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:12:56.659337 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10623449'] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:56.761089 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['6c613458-8891-4e54-aa10-4a7743587916'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:12:56.852175 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6e271dc-4c4f-4ba3-aaa1-0f91fa218595 tempest-TestMinimumBasicScenario-955737390 tempest-TestMinimumBasicScenario-955737390-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:56.854222 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-b6e271dc-4c4f-4ba3-aaa1-0f91fa218595 tempest-TestMinimumBasicScenario-955737390 tempest-TestMinimumBasicScenario-955737390-project-admin] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1093 time: 0.2748334
Jun 01 11:12:56.857318 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35318) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:12:56.863079 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'floatingip': {'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'port_id': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'fixed_ip_address': '172.20.0.3'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:12:56.869843 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:12:56.873768 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Usage tracker for resource:floatingip and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:12:56.878246 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:12:56.885409 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:12:56.896908 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for floatingip, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:57.039529 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:57.133465 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10882903', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10623439'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:57.138812 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0542c75b-7957-4077-b5d3-a20322605456 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:57.208207 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Allocated IP 172.27.3.129 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/de059772-4741-4e2f-b3a6-1be9653cdf74) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:12:57.260254 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Pushing event updated for resources: {'Subnet': ['ID=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:57.264707 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:57.272481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Checking segment: {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:12:57.272921 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Network hostable DHCP agents. Network: 10ec91f8-5d7c-496e-a32a-4dcea0b24793, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:12:57.309451 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:12:57.325554 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 10ec91f8-5d7c-496e-a32a-4dcea0b24793) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:12:57.342179 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1459939-e093-4d0c-b91e-47da003c6aaf None None] Network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:12:57.362861 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783f435b-35b9-48ce-a538-e739722c0ba8 req-3d9860ce-bbdb-439d-b4e8-4c18b37b40d6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:57.364578 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-783f435b-35b9-48ce-a538-e739722c0ba8 req-3d9860ce-bbdb-439d-b4e8-4c18b37b40d6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 944 time: 0.1648877
Jun 01 11:12:57.366404 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:57.367105 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:57.377403 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:57.414829 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:57.428280 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:57.455113 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-783f435b-35b9-48ce-a538-e739722c0ba8 req-aaefaecb-df44-4c47-bfe2-835576773cd0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0748060
Jun 01 11:12:57.469093 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:12:57.484319 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-cb80e8e9-73ba-48cb-8550-b3c1d510a60c admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 0.8630462
Jun 01 11:12:57.485910 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:12:57.498941 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:12:57.579673 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1170021-18e9-4c20-bfc8-fc4bf2123783 req-0d5be092-c94b-409b-8a6a-ce9507f60d25 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:57.581118 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a1170021-18e9-4c20-bfc8-fc4bf2123783 req-0d5be092-c94b-409b-8a6a-ce9507f60d25 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0886834
Jun 01 11:12:57.594876 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c3125fc-3c62-47da-9483-0faed0e6d068 None None] Network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:12:57.620773 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'Port': ['ID=de059772-4741-4e2f-b3a6-1be9653cdf74,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:57.625253 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:57.720138 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a1170021-18e9-4c20-bfc8-fc4bf2123783 req-442e37e6-0d5e-497c-a718-b6cda93f48ac tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0821271
Jun 01 11:12:57.758694 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0b27bd-c11c-44a3-9f76-dbbc245cdd70 req-644403c1-4a86-4768-92d3-10e391c1030f tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:57.761321 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6e0b27bd-c11c-44a3-9f76-dbbc245cdd70 req-644403c1-4a86-4768-92d3-10e391c1030f tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 945 time: 0.1789370
Jun 01 11:12:57.808347 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6e0b27bd-c11c-44a3-9f76-dbbc245cdd70 req-17fd2e5d-3312-499e-a7a3-de30d700fb48 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412543
Jun 01 11:12:57.837513 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:58.130618 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-501e3e93-c305-45ac-a5fc-7470c886eae3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:58.132007 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-501e3e93-c305-45ac-a5fc-7470c886eae3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 815 time: 0.1473479
Jun 01 11:12:58.147755 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-6078793f-6819-45dc-aa5d-639e2adfa88f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/quotas/a83ba65361364d0fad1aa55a0f8cb7cf HTTP/1.1" status: 200  len: 375 time: 0.0092497
Jun 01 11:12:58.164549 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:12:58.198815 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-8aa55132-98be-410c-9e06-386ff2efb9f3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0443895
Jun 01 11:12:58.235654 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for floatingip, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:58.239975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 6c613458-8891-4e54-aa10-4a7743587916 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:12:58.240473 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:58.363569 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:58.365030 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:58.393762 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c613458-8891-4e54-aa10-4a7743587916'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:12:58.395960 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a62682a-0cf5-48fb-beea-8be994694ed0" -d '{"events": [{"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-plugged", "status": "completed", "tag": "6c613458-8891-4e54-aa10-4a7743587916"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:12:58.404347 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:12:58.410435 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:58.412960 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:58.437367 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-435f5c46-19ee-4e02-864f-ab744a324710 service neutron] 10.222.0.74 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2317600
Jun 01 11:12:58.455499 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:12:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b0cce09-226b-4c2e-a6da-344e61a5b35c x-openstack-request-id: req-6b0cce09-226b-4c2e-a6da-344e61a5b35c {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:12:58.455826 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-plugged", "status": "completed", "tag": "6c613458-8891-4e54-aa10-4a7743587916", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:12:58.456093 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-6b0cce09-226b-4c2e-a6da-344e61a5b35c {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:12:58.456490 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c613458-8891-4e54-aa10-4a7743587916', 'code': 200}
Jun 01 11:12:58.497414 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=10']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:58.506637 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:58.573919 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-78cf4b68-720b-49b5-893b-211badfad893 service neutron] 10.222.0.74 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1356874
Jun 01 11:12:58.618117 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:58.624464 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:58.628986 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:12:58.669502 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b596247-ca23-40a5-9dce-6b2ddd696b7c req-4066bb5f-ef9c-4238-b6ae-95d69c674f08 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:58.671007 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3b596247-ca23-40a5-9dce-6b2ddd696b7c req-4066bb5f-ef9c-4238-b6ae-95d69c674f08 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 946 time: 0.0875249
Jun 01 11:12:58.726256 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3b596247-ca23-40a5-9dce-6b2ddd696b7c req-2cfa08e0-e066-4bbc-b1c6-f3864e1f4617 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0491900
Jun 01 11:12:58.777091 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'Port': ['ID=de059772-4741-4e2f-b3a6-1be9653cdf74,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:12:58.779731 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:58.808396 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3fd2420d-537d-41e2-be80-12339f245d7a req-bc5d1206-3908-4811-836b-4c16e6fd6b20 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 210 time: 0.0542266
Jun 01 11:12:58.849469 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:12:58.971006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f171305d-2afa-4c24-be91-b59081e0a463 req-f4377491-ca79-4706-9c49-39060591fef1 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:58.974625 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f171305d-2afa-4c24-be91-b59081e0a463 req-f4377491-ca79-4706-9c49-39060591fef1 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1403649
Jun 01 11:12:59.007272 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.l3_db [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Floating IP ed132e90-616d-4634-af5b-886d5c0141b2 associated. External IP: 172.27.3.129, port: f413cb23-a18e-4d8d-ab19-6cd2b065bc6f.
Jun 01 11:12:59.147016 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f171305d-2afa-4c24-be91-b59081e0a463 req-e146a30e-6438-4973-9449-f3a5ad8a4b49 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1648393
Jun 01 11:12:59.184494 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a77f0fe8-b63d-4cab-9984-b203f155bb79 req-9b1d504a-ebe4-4c99-bdd5-32549ee8fced tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:59.186720 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a77f0fe8-b63d-4cab-9984-b203f155bb79 req-9b1d504a-ebe4-4c99-bdd5-32549ee8fced tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 945 time: 0.2056911
Jun 01 11:12:59.189614 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f424ce95-7cfc-4c77-b4a3-07c91369ae29 req-01406724-0d63-46f3-abf0-ac6d7c288f26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:59.191199 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f424ce95-7cfc-4c77-b4a3-07c91369ae29 req-01406724-0d63-46f3-abf0-ac6d7c288f26 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 1099 time: 0.1476347
Jun 01 11:12:59.268405 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a77f0fe8-b63d-4cab-9984-b203f155bb79 req-b6875f18-14dd-4216-81d1-d4f964ba281a tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0745876
Jun 01 11:12:59.276236 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f424ce95-7cfc-4c77-b4a3-07c91369ae29 req-6e915377-d992-42f7-bb2b-e2ab10da8d6f service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0653179
Jun 01 11:12:59.411349 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-bb803ebd-488c-4354-81ea-891459d076bf tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:12:59.412075 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-bb803ebd-488c-4354-81ea-891459d076bf tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Synchronizing usage tracker for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:port {{(pid=119240) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:12:59.455293 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-bb803ebd-488c-4354-81ea-891459d076bf tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Unset dirty status for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:port {{(pid=119240) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:12:59.456439 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-bb803ebd-488c-4354-81ea-891459d076bf tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.79 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 945 time: 0.2700150
Jun 01 11:12:59.586337 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:12:59.843158 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:12:59.856012 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] Sync routers for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:12:59.867492 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Deleting port 66c448af-86b3-414d-8e93-0176f06e6420 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:12:59.867801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:12:59.873295 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:12:59.875189 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798647d90>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:12:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:12:59.895090 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.033799 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 3.1752803
Jun 01 11:13:00.037458 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:00.039873 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-785e09a6-42a5-445d-912c-a9f12e76a051" -d '{"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:00.045193 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35370) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:00.052971 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2039820528', 'description': 'tempest-secgroup-smoke-2039820528 description', 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:00.069282 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:00.075120 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-549f2819-7019-47b9-a8bc-c19828ade39b req-b5bbf493-5cc9-4b1a-9d5e-e9e9d3750f1a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 210 time: 0.0678015
Jun 01 11:13:00.081758 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] For port 66c448af-86b3-414d-8e93-0176f06e6420, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=66c448af-86b3-414d-8e93-0176f06e6420,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:00.082077 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.095303 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:00.118738 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02296e32-7691-4048-afc1-421646298fcd req-c6bd66c9-ff01-474f-8524-ed844178503a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:00.126615 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-02296e32-7691-4048-afc1-421646298fcd req-c6bd66c9-ff01-474f-8524-ed844178503a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 946 time: 0.2767904
Jun 01 11:13:00.172803 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-7454fe74-bb92-4518-a0ee-bdd147ded69e tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:00.174350 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-7454fe74-bb92-4518-a0ee-bdd147ded69e tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 815 time: 0.2710350
Jun 01 11:13:00.191973 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Request body: {'port': {'device_id': 'a11e9bbf-95ca-46df-bb08-7380420cf585', 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793', 'admin_state_up': True, 'tenant_id': 'a83ba65361364d0fad1aa55a0f8cb7cf'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:00.216986 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Calling delete_port for 66c448af-86b3-414d-8e93-0176f06e6420 owned by compute:nova {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:13:00.229581 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.231037 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:13:00.256855 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9c962e83-d25a-48f1-b17a-19e8a7a2edac x-openstack-request-id: req-9c962e83-d25a-48f1-b17a-19e8a7a2edac {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:00.257207 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:00.257469 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-9c962e83-d25a-48f1-b17a-19e8a7a2edac {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:00.257992 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'status': 'completed', 'code': 200}
Jun 01 11:13:00.269287 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:00.273641 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Usage tracker for resource:security_group_rule and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:00.276796 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:00.283185 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:00.360137 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.370907 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.377604 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e9d0d61b-170f-448f-b0c3-2e4c11c4dd3e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:00.413865 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'SecurityGroup': ['ID=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:00.420148 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:00.455295 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.459298 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.4108248
Jun 01 11:13:00.486830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:00.490927 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35386) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:00.503073 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'security_group_rule': {'security_group_id': '49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3', 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:00.517348 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:00.526001 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Usage tracker for resource:security_group_rule and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:00.530985 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:00.541415 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:00.552278 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Usage tracker for resource:port and tenant:a83ba65361364d0fad1aa55a0f8cb7cf is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:00.558874 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Quota usage for port was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:00.567540 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.570124 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-02296e32-7691-4048-afc1-421646298fcd req-c28a3de6-216d-4110-8c39-fb7459b6ee22 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.4425256
Jun 01 11:13:00.586062 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:00.602647 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.629888 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-89cfd583-ac52-455c-a7e2-8eb4b9dd64f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:00.645102 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Made reservation on behalf of a83ba65361364d0fad1aa55a0f8cb7cf for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:13:00.648601 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.684078 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-a2e56b5f-9a53-4f6e-83bf-c8adaac684a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:00.685569 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-a2e56b5f-9a53-4f6e-83bf-c8adaac684a3 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1098 time: 0.2957129
Jun 01 11:13:00.736990 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Pushing event deleted for resources: {'Port': ['ID=66c448af-86b3-414d-8e93-0176f06e6420,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:00.739990 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:00.828782 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] No DVR routers for this DVR port 66c448af-86b3-414d-8e93-0176f06e6420 on host hv-cinder-78776 {{(pid=119240) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:13:00.831353 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.847224 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798647d90>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:42Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': 'ed132e90-616d-4634-af5b-886d5c0141b2', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'port_id': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 423, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'mac_address': 'fa:16:3e:db:2f:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:12:57Z', 'updated_at': '2021-06-01T11:12:57Z', 'revision_number': 0, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e95624ae-5876-4f15-ad18-6a0cf9360081', 'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'mac_address': 'fa:16:3e:79:34:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_interface', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:41Z', 'updated_at': '2021-06-01T11:11:48Z', 'revision_number': 5, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'subnets': [{'id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:13:00.850057 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.854665 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] Checking router: a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:13:00.857407 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.866582 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:00.869989 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:13:00.870791 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798647d90>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:12:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:13:00.880402 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-041abf60-9968-4e15-a627-c1e77366140b req-97dba513-eb1a-4a01-afd0-7f018451083a tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=162fa94a-e72c-4955-b021-ee4d6defe252 HTTP/1.1" status: 200  len: 210 time: 0.1106982
Jun 01 11:13:00.880738 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-1aa6e7c0-285b-476f-b2b8-92919e73376f req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.79 "DELETE /v2.0/ports/66c448af-86b3-414d-8e93-0176f06e6420 HTTP/1.1" status: 204  len: 173 time: 1.4121714
Jun 01 11:13:00.889814 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e379ff21-d20b-457b-87ae-f2f53dc523ea,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:00.893122 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:00.898122 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c7dc2b-86ad-4122-b0b2-ed21f285cd7f req-b17f365c-de8c-4435-bdd8-d5142d03cd0b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:00.900928 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:00.903199 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-a19cd489-d7c0-49ca-aab1-3c4240bb232c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4112005
Jun 01 11:13:00.905803 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d4c7dc2b-86ad-4122-b0b2-ed21f285cd7f req-b17f365c-de8c-4435-bdd8-d5142d03cd0b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.4121740
Jun 01 11:13:00.906513 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35414) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:00.919740 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'security_group_rule': {'security_group_id': '49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3', 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:00.926938 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:00.931145 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Usage tracker for resource:security_group_rule and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:00.935812 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:00.944752 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:00.967433 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.060265 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.069049 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.073258 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:01.114226 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=76a8f010-dfc5-4843-969b-a8d2449ccbdc,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:01.117419 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.131564 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.2209940
Jun 01 11:13:01.131564 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:01.133844 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35428) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:01.148639 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'security_group_rule': {'security_group_id': '49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3', 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:01.165800 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:01.169891 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Usage tracker for resource:security_group_rule and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:01.172893 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:01.183092 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:01.216801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.225054 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Allocated IP 172.20.0.12 (10ec91f8-5d7c-496e-a32a-4dcea0b24793/6ccfaae8-bb7e-4cdd-ba83-2bee1577d247/7d85ff7b-1fb9-4870-919d-49ce962b290b) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:13:01.263329 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:13:01.308098 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.312249 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.314318 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:01.318117 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d4c7dc2b-86ad-4122-b0b2-ed21f285cd7f req-522b738c-6bc1-462f-9625-6c0e26bda2e6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.4113884
Jun 01 11:13:01.346167 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f16ea4e9-1c9b-4d20-9b82-976f14ca6be7,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:01.349730 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:01.355005 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.356770 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-4094c2c8-69fe-4874-9f61-fa897bcd3db4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2188866
Jun 01 11:13:01.359892 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35434) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:01.369808 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'security_group_rule': {'security_group_id': '49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3', 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:01.377215 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:01.381990 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Usage tracker for resource:security_group_rule and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:01.386520 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:01.393344 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:01.415756 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.506143 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.516931 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.539446 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:01.568061 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=81798bab-a997-4b87-bcd4-f09b80e82d24,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:01.577560 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:01.585397 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.586922 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.2222428
Jun 01 11:13:01.589536 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35440) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:01.602998 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'security_group_rule': {'security_group_id': '49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3', 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:01.615727 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:01.623790 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Usage tracker for resource:security_group_rule and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:01.631502 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:01.641960 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:01.662793 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.securitygroups_db [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Project 5c3d0a0f97d246d5a7afac5ec8c4d43c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 11:13:01.671682 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.689220 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.712811 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b1915341-fd19-4623-9e7e-c97707339f8c req-d0bf7e2b-21f6-4a92-aa14-ec4b46cc1ac5 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 210 time: 0.3908572
Jun 01 11:13:01.719299 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-7781804f-12b8-451e-835e-087d1030b260 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:01.720713 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-7781804f-12b8-451e-835e-087d1030b260 service neutron] 10.222.0.79 "GET /v2.0/networks?id=7356920a-571e-467c-9250-df782b9d8129 HTTP/1.1" status: 200  len: 915 time: 0.9057710
Jun 01 11:13:01.800575 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798647d90>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:42Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': 'ed132e90-616d-4634-af5b-886d5c0141b2', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'port_id': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 423, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'mac_address': 'fa:16:3e:db:2f:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:12:57Z', 'updated_at': '2021-06-01T11:12:57Z', 'revision_number': 0, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e95624ae-5876-4f15-ad18-6a0cf9360081', 'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'mac_address': 'fa:16:3e:79:34:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_interface', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:41Z', 'updated_at': '2021-06-01T11:11:48Z', 'revision_number': 5, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'subnets': [{'id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:13:01.801205 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.805532 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d52836f-926b-4bd1-b277-1128f123232f None None] The sync data for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi is: [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:42Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': 'ed132e90-616d-4634-af5b-886d5c0141b2', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'port_id': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 423, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'mac_address': 'fa:16:3e:db:2f:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:12:57Z', 'updated_at': '2021-06-01T11:12:57Z', 'revision_number': 0, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e95624ae-5876-4f15-ad18-6a0cf9360081', 'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'mac_address': 'fa:16:3e:79:34:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_interface', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:41Z', 'updated_at': '2021-06-01T11:11:48Z', 'revision_number': 5, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'subnets': [{'id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:13:01.811206 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.813352 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7a822fb0-fce6-4fe9-9002-3cd7cc166bb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:01.839045 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1f4d584e-0084-4fd6-aa5f-4f6bd50bf2b6,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:01.843775 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:01.906620 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.907819 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3171721
Jun 01 11:13:01.913059 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35448) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:01.921658 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'security_group_rule': {'security_group_id': '49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3', 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:01.933544 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:01.938758 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Usage tracker for resource:security_group_rule and tenant:5c3d0a0f97d246d5a7afac5ec8c4d43c is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:01.942706 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:01.949460 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:01.957262 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-67537a1f-da95-4cf4-a8f0-df71f6d2c6dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:01.958722 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-67537a1f-da95-4cf4-a8f0-df71f6d2c6dc service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 1098 time: 0.1161392
Jun 01 11:13:01.964730 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.securitygroups_db [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Project 5c3d0a0f97d246d5a7afac5ec8c4d43c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 11:13:01.989856 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:01.995292 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:02.003985 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c8dcac05-9c4f-4ac5-9802-cffbf6e81b81 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:02.038909 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-93b43204-6fb0-4d19-bbcc-c994bc4483c2 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 999 time: 0.2431855
Jun 01 11:13:02.040451 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9feacaa-193a-4bdd-86fc-8d69c90f5fde None None] New status for floating IP ed132e90-616d-4634-af5b-886d5c0141b2: ACTIVE {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:13:02.124723 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:13:02.137031 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19f53a7-91e2-4476-902a-22a3560f7f35 req-e0ff9a7a-a111-4352-a278-3269a5d1aaa9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:02.138487 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f19f53a7-91e2-4476-902a-22a3560f7f35 req-e0ff9a7a-a111-4352-a278-3269a5d1aaa9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.4223366
Jun 01 11:13:02.148017 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:13:02.160882 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:13:02.180675 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 66c448af-86b3-414d-8e93-0176f06e6420 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:13:02.210798 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Pushing event updated for resources: {'Port': ['ID=7d85ff7b-1fb9-4870-919d-49ce962b290b,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:02.227323 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:02.234095 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-060f7b75-f091-4b59-af11-aca6026ee1fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:02.235555 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-060f7b75-f091-4b59-af11-aca6026ee1fa service neutron] 10.222.0.79 "GET /v2.0/subnets?id=c5b015bf-9c86-450a-8cbd-8892adfddfb6 HTTP/1.1" status: 200  len: 853 time: 0.1823773
Jun 01 11:13:02.243258 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-ec7e90ed-c297-47ab-8266-89999bdadb41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:02.245247 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-ec7e90ed-c297-47ab-8266-89999bdadb41 service neutron] 10.222.0.79 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 911 time: 0.2761874
Jun 01 11:13:02.249682 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:02.250090 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 66c448af-86b3-414d-8e93-0176f06e6420 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:13:02.250899 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 66c448af-86b3-414d-8e93-0176f06e6420 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:13:02.263226 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f03122e6-baeb-4499-ac37-1b3f77f3efba req-3e8d6d31-9ace-45cd-857c-785fca40bb0c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:02.264734 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f03122e6-baeb-4499-ac37-1b3f77f3efba req-3e8d6d31-9ace-45cd-857c-785fca40bb0c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 946 time: 0.3760412
Jun 01 11:13:02.301674 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '162fa94a-e72c-4955-b021-ee4d6defe252', 'name': 'network-vif-deleted', 'tag': '66c448af-86b3-414d-8e93-0176f06e6420'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:02.304636 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ade6bc08-c89c-4bcb-a4fd-ee7210ac5b7b" -d '{"events": [{"server_uuid": "162fa94a-e72c-4955-b021-ee4d6defe252", "name": "network-vif-deleted", "tag": "66c448af-86b3-414d-8e93-0176f06e6420"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:02.315074 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:02.334970 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-31ef4dd7-146c-4295-924b-7f14f1d2f890 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:02.342351 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f19f53a7-91e2-4476-902a-22a3560f7f35 req-43023a4b-a0bf-4abc-863e-c8d2be752ccc tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1878383
Jun 01 11:13:02.354164 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:02.354781 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:02.371618 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4f83181c-529e-43c6-be1c-d91a2924900b,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:02.378034 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:02.394454 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-094cc435-2428-428b-86d9-b60f7f69d041 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263 HTTP/1.1" status: 200  len: 1000 time: 0.1424949
Jun 01 11:13:02.395420 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:02.399495 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6c56b3a3-da09-44b0-816e-b1c315ff422b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.4818304
Jun 01 11:13:02.404557 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f03122e6-baeb-4499-ac37-1b3f77f3efba req-73c44a54-1bcd-4dc4-9f8f-06ce3bd686e6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1015842
Jun 01 11:13:02.407310 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.2206719
Jun 01 11:13:02.421925 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Request body: {'port': {'device_id': 'a11e9bbf-95ca-46df-bb08-7380420cf585', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:02.477048 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-b6b51c19-1f20-4571-8cbd-c6c9772da60b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:02.479101 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-b6b51c19-1f20-4571-8cbd-c6c9772da60b service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7356920a-571e-467c-9250-df782b9d8129&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2288630
Jun 01 11:13:02.484789 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec7c784f-16f3-40c7-9b3c-980a53f54b7a x-openstack-request-id: req-ec7c784f-16f3-40c7-9b3c-980a53f54b7a {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:02.485288 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "162fa94a-e72c-4955-b021-ee4d6defe252", "name": "network-vif-deleted", "tag": "66c448af-86b3-414d-8e93-0176f06e6420", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:02.485518 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-ec7c784f-16f3-40c7-9b3c-980a53f54b7a {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:02.485858 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '162fa94a-e72c-4955-b021-ee4d6defe252', 'name': 'network-vif-deleted', 'tag': '66c448af-86b3-414d-8e93-0176f06e6420', 'status': 'completed', 'code': 200}
Jun 01 11:13:02.487544 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-b8433b38-c5a9-46b8-ad76-a37dca0850cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:02.489082 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-b8433b38-c5a9-46b8-ad76-a37dca0850cd service neutron] 10.222.0.79 "GET /v2.0/subnets?id=08c4a15d-0d06-4d4b-909f-10ac28c5c16c HTTP/1.1" status: 200  len: 849 time: 0.0887790
Jun 01 11:13:02.585992 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-d08bfad2-e322-4411-9b14-d1826b742dac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:02.587522 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-d08bfad2-e322-4411-9b14-d1826b742dac service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=418faffe-faca-4025-ab0f-56771435263e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0909755
Jun 01 11:13:02.664284 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:02.707546 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-270786ca-5980-46f0-ae03-db42bf2ddd4a tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2039820528&fields=id&tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c HTTP/1.1" status: 200  len: 267 time: 0.1445978
Jun 01 11:13:02.728901 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-27dcec29-95db-4d25-9dd9-48dbb6d83270 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1345727
Jun 01 11:13:02.764180 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-61cd0248-90f0-4381-b600-f84e9559f311 service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2732720
Jun 01 11:13:02.896477 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-3c8ce211-dbf2-45b3-9dfb-414e916ffba8 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1610789
Jun 01 11:13:03.203658 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-785e09a6-42a5-445d-912c-a9f12e76a051 req-36c8a970-c1c7-4fde-9f18-1ed216e384d9 service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4318855
Jun 01 11:13:03.228946 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d4bc30c1-d557-4319-aae6-348cacc6e91e tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:03.230456 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d4bc30c1-d557-4319-aae6-348cacc6e91e tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.4740460
Jun 01 11:13:03.292552 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'port': {'security_groups': ['b439d80e-05e2-4757-aaae-a9fee5f6d9ee', '49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:03.479787 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450f2fe7-1d35-4815-be1f-d6e116308764 req-0dfab876-ce62-405a-a8df-4c62c2b3c4e1 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:03.480477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-450f2fe7-1d35-4815-be1f-d6e116308764 req-0dfab876-ce62-405a-a8df-4c62c2b3c4e1 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Synchronizing usage tracker for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:13:03.487441 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:03.572371 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-450f2fe7-1d35-4815-be1f-d6e116308764 req-0dfab876-ce62-405a-a8df-4c62c2b3c4e1 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Unset dirty status for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:13:03.573489 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-450f2fe7-1d35-4815-be1f-d6e116308764 req-0dfab876-ce62-405a-a8df-4c62c2b3c4e1 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 932 time: 0.5470970
Jun 01 11:13:03.688341 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7d85ff7b-1fb9-4870-919d-49ce962b290b {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:13:03.709975 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:03.720801 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-450f2fe7-1d35-4815-be1f-d6e116308764 req-ddea6455-1478-4ce7-9f73-a4180c09b0ab tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1126463
Jun 01 11:13:03.739367 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Transition to ACTIVE for port object 7d85ff7b-1fb9-4870-919d-49ce962b290b will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:13:03.761737 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:03.768882 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:04.054067 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Pushing event updated for resources: {'Port': ['ID=7d85ff7b-1fb9-4870-919d-49ce962b290b,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:04.066902 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:04.125174 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] For port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:04.188141 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6506fe6-8efe-4033-99db-37e0c2696e05 req-552fdd8b-7585-43ba-9bf1-5f6d068ac206 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:04.189591 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a6506fe6-8efe-4033-99db-37e0c2696e05 req-552fdd8b-7585-43ba-9bf1-5f6d068ac206 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.3304334
Jun 01 11:13:04.192031 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Attempting to bind port 7d85ff7b-1fb9-4870-919d-49ce962b290b on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:13:04.192364 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Attempting to bind port 7d85ff7b-1fb9-4870-919d-49ce962b290b by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:13:04.192687 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Attempting to bind port 7d85ff7b-1fb9-4870-919d-49ce962b290b on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:13:04.195860 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:04.215485 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Port 7d85ff7b-1fb9-4870-919d-49ce962b290b on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:13:04.215830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Attempting to bind port 7d85ff7b-1fb9-4870-919d-49ce962b290b on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:13:04.221322 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:04.230181 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b48b4d7e-68c5-4560-956b-c18adaa7d9b4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:04.263468 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 12, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:13:04.263828 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Checking segment: {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:13:04.264205 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Bound using segment: {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:13:04.264638 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Bound port: 7d85ff7b-1fb9-4870-919d-49ce962b290b, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:13:04.264981 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:04.349719 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a6506fe6-8efe-4033-99db-37e0c2696e05 req-8ba6b10b-72ab-473d-9818-be52239dacfc tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1514997
Jun 01 11:13:04.373263 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:04.373870 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:04.375218 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c58ac4b1-1311-4ab0-90d1-d140279589ab req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "PUT /v2.0/ports/f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 981 time: 1.1366520
Jun 01 11:13:04.378232 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:04.380283 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00" -d '{"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:04.412174 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'Port': ['ID=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,revision_number=6']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:04.416917 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:04.427136 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] For port 7d85ff7b-1fb9-4870-919d-49ce962b290b, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:13:04.430318 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] For port 7d85ff7b-1fb9-4870-919d-49ce962b290b, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7d85ff7b-1fb9-4870-919d-49ce962b290b,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:13:04.436474 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:04.442885 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3b65d4a7-5d44-4d83-bcde-7064c97724e5 x-openstack-request-id: req-3b65d4a7-5d44-4d83-bcde-7064c97724e5 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:04.443384 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:04.443873 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-3b65d4a7-5d44-4d83-bcde-7064c97724e5 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:04.444488 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'status': 'completed', 'code': 200}
Jun 01 11:13:04.445161 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:04.540983 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:04.541580 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:04.542913 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] 10.222.0.79 "PUT /v2.0/ports/7d85ff7b-1fb9-4870-919d-49ce962b290b HTTP/1.1" status: 200  len: 1094 time: 2.1272414
Jun 01 11:13:04.575999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Pushing event updated for resources: {'Port': ['ID=7d85ff7b-1fb9-4870-919d-49ce962b290b,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:04.579435 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:04.604075 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c54f319f-6b92-4c24-8d09-e087bb5293fa req-9cee786d-c7e9-41ff-81ce-3949e4886906 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:04.605548 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c54f319f-6b92-4c24-8d09-e087bb5293fa req-9cee786d-c7e9-41ff-81ce-3949e4886906 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.1092818
Jun 01 11:13:04.624122 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-ca238e53-2e65-43bc-88ad-aad01df1d89e None None] Provisioning complete for port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:13:04.624642 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ca238e53-2e65-43bc-88ad-aad01df1d89e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:04.656212 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c54f319f-6b92-4c24-8d09-e087bb5293fa req-c5ba750e-3801-43e0-ab9e-a7d07ae90cc4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0447445
Jun 01 11:13:04.902769 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20ac716a-213f-4c38-9434-d5341745dca6 req-b8939c6e-1958-4b28-85cd-73e1ebb422c8 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:04.904235 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-20ac716a-213f-4c38-9434-d5341745dca6 req-b8939c6e-1958-4b28-85cd-73e1ebb422c8 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 944 time: 0.0787857
Jun 01 11:13:04.952534 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-20ac716a-213f-4c38-9434-d5341745dca6 req-4fde57fe-bebe-466d-8c1b-6807765703b9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423992
Jun 01 11:13:05.539228 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01fa3920-de1f-4370-952e-909a2b388110 req-7e1d238d-204e-454f-96aa-6857d17c0b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:05.540738 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-01fa3920-de1f-4370-952e-909a2b388110 req-7e1d238d-204e-454f-96aa-6857d17c0b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0846429
Jun 01 11:13:05.586407 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-01fa3920-de1f-4370-952e-909a2b388110 req-9460a5a9-b3cd-4a09-864a-89fe7dccedf7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388265
Jun 01 11:13:05.971155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:13:06.074295 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:13:06.309762 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-8868f198-2aec-4beb-868d-f9087ab27f5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:06.311152 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-8868f198-2aec-4beb-868d-f9087ab27f5d service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 1097 time: 0.2798617
Jun 01 11:13:06.315694 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-71e6f02d-a4fa-48fb-b9d3-97d8c5244e89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:06.317074 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-71e6f02d-a4fa-48fb-b9d3-97d8c5244e89 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1137 time: 0.3163407
Jun 01 11:13:06.326258 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d86113b4-7c8a-4f5b-ac2d-f07bc3b35ba4 req-fa57c1ad-b271-4cbf-b296-dcbaa086ef08 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:06.327771 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d86113b4-7c8a-4f5b-ac2d-f07bc3b35ba4 req-fa57c1ad-b271-4cbf-b296-dcbaa086ef08 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 944 time: 0.2515373
Jun 01 11:13:06.429834 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-40f9b875-64ac-43a9-8bbf-cd2809feee33 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7d85ff7b-1fb9-4870-919d-49ce962b290b HTTP/1.1" status: 200  len: 217 time: 0.0997858
Jun 01 11:13:06.480051 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a11e9bbf-95ca-46df-bb08-7380420cf585', 'tag': '7d85ff7b-1fb9-4870-919d-49ce962b290b'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:06.482320 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a" -d '{"events": [{"name": "network-changed", "server_uuid": "a11e9bbf-95ca-46df-bb08-7380420cf585", "tag": "7d85ff7b-1fb9-4870-919d-49ce962b290b"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:06.538752 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d284e93-85aa-4b58-b0a5-678f7b945bfe x-openstack-request-id: req-4d284e93-85aa-4b58-b0a5-678f7b945bfe {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:06.539089 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a11e9bbf-95ca-46df-bb08-7380420cf585", "tag": "7d85ff7b-1fb9-4870-919d-49ce962b290b", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:06.539350 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-4d284e93-85aa-4b58-b0a5-678f7b945bfe {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:06.539932 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a11e9bbf-95ca-46df-bb08-7380420cf585', 'tag': '7d85ff7b-1fb9-4870-919d-49ce962b290b', 'status': 'completed', 'code': 200}
Jun 01 11:13:06.569472 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d86113b4-7c8a-4f5b-ac2d-f07bc3b35ba4 req-633f9d0e-d21f-4928-9429-1b9db43c2a21 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1902480
Jun 01 11:13:06.597820 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-dc481bd7-a4b8-400d-968c-b4f7bf159363 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:06.599243 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-dc481bd7-a4b8-400d-968c-b4f7bf159363 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 HTTP/1.1" status: 200  len: 855 time: 0.1124640
Jun 01 11:13:06.656702 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-581d53ad-d479-4c75-9284-12f8c234c3e5 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=10ec91f8-5d7c-496e-a32a-4dcea0b24793&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0478013
Jun 01 11:13:06.661582 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-27ef6741-9087-4c98-82d5-3749f4deae40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:06.662509 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-27ef6741-9087-4c98-82d5-3749f4deae40 service neutron] 10.222.0.79 "GET /v2.0/networks?id=7356920a-571e-467c-9250-df782b9d8129 HTTP/1.1" status: 200  len: 915 time: 0.2823744
Jun 01 11:13:06.907328 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-83d089f2-3df5-445b-a3f8-f6f366ad32c0 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 1001 time: 0.2231078
Jun 01 11:13:06.983842 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-3e84e463-1aaa-4435-a5b1-69a7a664168c service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3200698
Jun 01 11:13:07.020719 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b33fa89-7b8d-4ac3-9d1b-98061fd0d985 req-3707decd-e4ce-4e27-a59b-663899b55e7b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:07.022170 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b33fa89-7b8d-4ac3-9d1b-98061fd0d985 req-3707decd-e4ce-4e27-a59b-663899b55e7b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.2807479
Jun 01 11:13:07.026478 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-399dd09e-31b1-41a7-bf6a-f731fbbcdec2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:07.027846 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-399dd09e-31b1-41a7-bf6a-f731fbbcdec2 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=c5b015bf-9c86-450a-8cbd-8892adfddfb6 HTTP/1.1" status: 200  len: 853 time: 0.1135824
Jun 01 11:13:07.193193 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1b33fa89-7b8d-4ac3-9d1b-98061fd0d985 req-d75430dc-63b7-4219-bc0c-b481eb7d6951 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1614881
Jun 01 11:13:07.224620 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ad0258fb-7c5c-4eae-8598-ba1b21f614a2 req-6c7b3a15-dc3e-4832-afd9-cb99781854b2 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2309191
Jun 01 11:13:07.233379 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-4a37f168-d578-477a-9ac7-b7c3054571e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:07.234805 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-4a37f168-d578-477a-9ac7-b7c3054571e7 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7356920a-571e-467c-9250-df782b9d8129&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1411402
Jun 01 11:13:07.440959 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-20b4cc9f-ceb7-4b87-a2cd-a4210e5a13aa service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1986051
Jun 01 11:13:07.443826 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-867e4209-01a8-4c23-b83b-a70eab98bb06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:07.445127 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-867e4209-01a8-4c23-b83b-a70eab98bb06 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 1097 time: 0.1659420
Jun 01 11:13:07.838433 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-71f20011-0ee9-4d37-ba5d-e10bb12d8d00 req-f4de92f3-b4a1-457c-a465-18d94decd8cf service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3740184
Jun 01 11:13:07.840203 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-fc5e9e0f-bbc2-4eb0-a689-4e826358b6bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:07.841491 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-fc5e9e0f-bbc2-4eb0-a689-4e826358b6bc service neutron] 10.222.0.79 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 916 time: 0.3600900
Jun 01 11:13:07.918646 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-76c94229-bde3-4aee-bb46-ac79bee65c19 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7d85ff7b-1fb9-4870-919d-49ce962b290b HTTP/1.1" status: 200  len: 217 time: 0.0667758
Jun 01 11:13:07.979223 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65444b24-9ec7-478b-8019-151047a4d88f req-1b0c820b-fb81-4963-916e-acff78a174c4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:07.980592 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-65444b24-9ec7-478b-8019-151047a4d88f req-1b0c820b-fb81-4963-916e-acff78a174c4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 944 time: 0.2309160
Jun 01 11:13:08.014490 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-f687f3b1-4cd6-427e-b03a-6ef6b4d8dede service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:08.015953 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-f687f3b1-4cd6-427e-b03a-6ef6b4d8dede service neutron] 10.222.0.79 "GET /v2.0/subnets?id=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 HTTP/1.1" status: 200  len: 855 time: 0.0897152
Jun 01 11:13:08.072454 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-1faedf3b-7726-4116-bbce-60705b47ca9c service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=10ec91f8-5d7c-496e-a32a-4dcea0b24793&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0464377
Jun 01 11:13:08.075312 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-65444b24-9ec7-478b-8019-151047a4d88f req-f204a99e-e318-4cfb-b4a4-78d704fa607d tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0879698
Jun 01 11:13:08.204564 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-9e129235-31db-45b1-b0ab-8dc8cf015c7b service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1229591
Jun 01 11:13:08.338926 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-95c7ac97-32c9-4ff4-b0e1-b3aab269bb6a req-0db43ac7-63f0-4063-90d2-a5a6baaee9b7 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1277432
Jun 01 11:13:09.254192 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b521d6-52e5-441b-8ddf-11b5ac2ffa1b req-1815358e-295d-4424-82ab-d0e59ea9dc14 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:09.255675 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-94b521d6-52e5-441b-8ddf-11b5ac2ffa1b req-1815358e-295d-4424-82ab-d0e59ea9dc14 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 944 time: 0.0781827
Jun 01 11:13:09.302528 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-94b521d6-52e5-441b-8ddf-11b5ac2ffa1b req-7517bc99-e32b-4867-bc92-d72136af5a1c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403101
Jun 01 11:13:09.803472 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:13:10.489501 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3119f791-be45-46d9-88f8-de514cafca3e req-6eb6218e-cdab-4486-9e19-4c367dae5f99 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:10.490956 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3119f791-be45-46d9-88f8-de514cafca3e req-6eb6218e-cdab-4486-9e19-4c367dae5f99 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 944 time: 0.0832980
Jun 01 11:13:10.536643 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3119f791-be45-46d9-88f8-de514cafca3e req-26d1bf11-20d7-4f6c-919d-9d420b790fdc tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392139
Jun 01 11:13:10.608101 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 7d85ff7b-1fb9-4870-919d-49ce962b290b details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:13:10.775472 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 7d85ff7b-1fb9-4870-919d-49ce962b290b, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7d85ff7b-1fb9-4870-919d-49ce962b290b,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:10.788584 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '7d85ff7b-1fb9-4870-919d-49ce962b290b', 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793', 'port_id': '7d85ff7b-1fb9-4870-919d-49ce962b290b', 'mac_address': 'fa:16:3e:4e:ed:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 682, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6ccfaae8-bb7e-4cdd-ba83-2bee1577d247', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:13:10.848170 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:10.866376 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7d85ff7b-1fb9-4870-919d-49ce962b290b {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:13:10.882364 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 7d85ff7b-1fb9-4870-919d-49ce962b290b, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7d85ff7b-1fb9-4870-919d-49ce962b290b,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:10.887349 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:10.890075 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:10.954831 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=7d85ff7b-1fb9-4870-919d-49ce962b290b,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:10.957996 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:11.730438 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a894ca15-dd2d-496c-9c01-02f1fead3a00 req-b8ba5696-8f33-4df6-88ce-fce4824fd88a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:11.732030 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a894ca15-dd2d-496c-9c01-02f1fead3a00 req-b8ba5696-8f33-4df6-88ce-fce4824fd88a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 945 time: 0.0888610
Jun 01 11:13:11.778546 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a894ca15-dd2d-496c-9c01-02f1fead3a00 req-236fdaaf-7c52-44f9-ad43-d2b8f69e98b0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393808
Jun 01 11:13:11.899130 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['7d85ff7b-1fb9-4870-919d-49ce962b290b'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:13:13.083653 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e708a8dc-2135-412d-88c9-c5b87e3f1847 req-f3fe810c-1a58-451c-ad40-5fb6e5c267d3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:13.085020 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e708a8dc-2135-412d-88c9-c5b87e3f1847 req-f3fe810c-1a58-451c-ad40-5fb6e5c267d3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 945 time: 0.2008355
Jun 01 11:13:13.093300 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-d8c260fd-037a-48c9-b204-3f2979d51030 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:13.094639 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-d8c260fd-037a-48c9-b204-3f2979d51030 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/networks?id=73f1ca3d-3f00-45a8-bb61-3d265d008491 HTTP/1.1" status: 200  len: 814 time: 0.1782360
Jun 01 11:13:13.122986 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-4da8a7b5-93dc-4587-a15f-eace600037f8 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/quotas/7e8afbfddd4f420185db35195f7b5d54 HTTP/1.1" status: 200  len: 375 time: 0.0147316
Jun 01 11:13:13.182959 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-18b3560d-68ff-442b-9088-f6d0f8b712a7 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=7e8afbfddd4f420185db35195f7b5d54&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0529797
Jun 01 11:13:13.185875 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e708a8dc-2135-412d-88c9-c5b87e3f1847 req-5f47b56b-e39d-4a7c-b42a-7f63d3074fc3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0903838
Jun 01 11:13:13.311888 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-e9415030-cd10-42e9-9b95-9d309a552f18 service neutron] 10.222.0.74 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1224043
Jun 01 11:13:13.442248 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-5b7b3229-d2aa-4418-9c59-6153c9d2dbbb service neutron] 10.222.0.74 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1245975
Jun 01 11:13:13.614037 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b02f850d-6a1f-4876-8b22-eb978f3de63a req-1f829772-bd7e-479d-8fcb-2ee979d91fdc tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 210 time: 0.0437214
Jun 01 11:13:14.254968 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 7d85ff7b-1fb9-4870-919d-49ce962b290b up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:13:14.325662 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 7d85ff7b-1fb9-4870-919d-49ce962b290b completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:13:14.330294 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 7d85ff7b-1fb9-4870-919d-49ce962b290b triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:13:14.330667 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:14.455672 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:14.465904 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c1d0031-6bb4-4b18-a87d-be0d37e2732b req-94ee609d-75a6-4ad9-9d90-1b8e240aee9c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:14.468117 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3c1d0031-6bb4-4b18-a87d-be0d37e2732b req-94ee609d-75a6-4ad9-9d90-1b8e240aee9c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 945 time: 0.1776109
Jun 01 11:13:14.482300 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a11e9bbf-95ca-46df-bb08-7380420cf585', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d85ff7b-1fb9-4870-919d-49ce962b290b'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:14.484556 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6060daf5-c21e-41aa-8e78-868f48012c87" -d '{"events": [{"server_uuid": "a11e9bbf-95ca-46df-bb08-7380420cf585", "name": "network-vif-plugged", "status": "completed", "tag": "7d85ff7b-1fb9-4870-919d-49ce962b290b"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:14.492398 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 7d85ff7b-1fb9-4870-919d-49ce962b290b, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7d85ff7b-1fb9-4870-919d-49ce962b290b,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:14.497863 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:14.500311 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:14.517561 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3c1d0031-6bb4-4b18-a87d-be0d37e2732b req-1881eef1-b070-4a0e-b948-38e3dbf51138 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433910
Jun 01 11:13:14.561751 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2fdcb288-a209-4c67-bb7c-9fcd5e69df90 x-openstack-request-id: req-2fdcb288-a209-4c67-bb7c-9fcd5e69df90 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:14.562628 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a11e9bbf-95ca-46df-bb08-7380420cf585", "name": "network-vif-plugged", "status": "completed", "tag": "7d85ff7b-1fb9-4870-919d-49ce962b290b", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:14.562892 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-2fdcb288-a209-4c67-bb7c-9fcd5e69df90 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:14.563281 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a11e9bbf-95ca-46df-bb08-7380420cf585', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d85ff7b-1fb9-4870-919d-49ce962b290b', 'code': 200}
Jun 01 11:13:14.585091 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=7d85ff7b-1fb9-4870-919d-49ce962b290b,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:14.588216 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:14.735318 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-aa6e9e51-0705-4f09-9a80-507642a3491c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:14.739295 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-aa6e9e51-0705-4f09-9a80-507642a3491c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.79 "GET /v2.0/networks?id=73f1ca3d-3f00-45a8-bb61-3d265d008491 HTTP/1.1" status: 200  len: 814 time: 0.1869400
Jun 01 11:13:14.757424 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Request body: {'port': {'device_id': '387c95c0-3fa6-40c5-8f8c-3b00df516718', 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491', 'admin_state_up': True, 'tenant_id': '7e8afbfddd4f420185db35195f7b5d54'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:14.869100 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eac9c0ee-829c-425c-b059-364378bdf0f7 req-8e29d9c8-6e7e-49ff-b9ab-c6426ecfc83f tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 210 time: 0.0879867
Jun 01 11:13:15.006438 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09aca74b-8b64-474b-b4d0-e268db47b6f0 req-a36c7da3-f038-40af-9855-69e5983ea6a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:15.007888 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-09aca74b-8b64-474b-b4d0-e268db47b6f0 req-a36c7da3-f038-40af-9855-69e5983ea6a0 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 1099 time: 0.1781781
Jun 01 11:13:15.008771 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:15.014002 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Usage tracker for resource:port and tenant:7e8afbfddd4f420185db35195f7b5d54 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:15.017765 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Quota usage for port was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:15.034676 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:15.057569 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Made reservation on behalf of 7e8afbfddd4f420185db35195f7b5d54 for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:13:15.061023 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:15.074095 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-09aca74b-8b64-474b-b4d0-e268db47b6f0 req-b79ad3b9-9858-4de7-91b4-de96216564c1 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0573442
Jun 01 11:13:15.219041 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Allocated IP 172.20.0.3 (73f1ca3d-3f00-45a8-bb61-3d265d008491/3d925639-91b9-4f79-8619-2a656b4099a2/3ad75ad9-2e01-4265-9705-f59d3e60c4e7) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:13:15.414589 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:15.443165 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:15.449006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3ef0b8cf-847f-4b4e-a1b4-0d2a84cceb7e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:15.518431 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Network 73f1ca3d-3f00-45a8-bb61-3d265d008491 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:13:15.521380 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:13:15.525531 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:13:15.559039 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Pushing event updated for resources: {'Port': ['ID=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:15.563415 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:15.591231 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:15.591867 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:15.614373 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8628526
Jun 01 11:13:15.627664 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Request body: {'port': {'device_id': '387c95c0-3fa6-40c5-8f8c-3b00df516718', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:15.801490 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:15.820924 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ddc013-6337-4c52-a57c-39a5ebedcb45 req-5b359b81-6a01-45fc-8839-05e6eac88bc6 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:15.822560 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-52ddc013-6337-4c52-a57c-39a5ebedcb45 req-5b359b81-6a01-45fc-8839-05e6eac88bc6 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 946 time: 0.1652060
Jun 01 11:13:15.919094 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-52ddc013-6337-4c52-a57c-39a5ebedcb45 req-ef563294-b57f-4664-a44d-470d97177021 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0677385
Jun 01 11:13:16.175711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d320657a-d8d5-4a19-a19b-441622a64c77 req-8965cf9a-2445-45b7-acee-a703cba1f432 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:16.176397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-d320657a-d8d5-4a19-a19b-441622a64c77 req-8965cf9a-2445-45b7-acee-a703cba1f432 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Synchronizing usage tracker for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:13:16.201144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-d320657a-d8d5-4a19-a19b-441622a64c77 req-8965cf9a-2445-45b7-acee-a703cba1f432 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Unset dirty status for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:13:16.202258 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d320657a-d8d5-4a19-a19b-441622a64c77 req-8965cf9a-2445-45b7-acee-a703cba1f432 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 931 time: 0.2251656
Jun 01 11:13:16.386203 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d320657a-d8d5-4a19-a19b-441622a64c77 req-43dc9309-8640-4412-92d4-2e762d1b3f94 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1758354
Jun 01 11:13:16.388514 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:13:16.396200 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:16.411354 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Transition to ACTIVE for port object 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:13:16.414830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:16.419133 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6dea8b23-8423-444d-b23c-5be9b70f4fad service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:16.570685 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Pushing event updated for resources: {'Port': ['ID=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:16.578451 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:16.582047 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:16.646651 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Attempting to bind port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:13:16.646985 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Attempting to bind port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '04a7072a-bdf8-4e49-a012-f597df9410a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 685, 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:13:16.647310 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Attempting to bind port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 on network 73f1ca3d-3f00-45a8-bb61-3d265d008491 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:13:16.651866 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 on network 73f1ca3d-3f00-45a8-bb61-3d265d008491 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:13:16.652187 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Attempting to bind port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 on network 73f1ca3d-3f00-45a8-bb61-3d265d008491 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:13:16.657166 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 13, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:13:16.657501 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Checking segment: {'id': '04a7072a-bdf8-4e49-a012-f597df9410a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 685, 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:13:16.657882 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Bound using segment: {'id': '04a7072a-bdf8-4e49-a012-f597df9410a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 685, 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:13:16.658304 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Bound port: 3ad75ad9-2e01-4265-9705-f59d3e60c4e7, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '04a7072a-bdf8-4e49-a012-f597df9410a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 685, 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:13:16.658645 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:16.747015 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] For port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:13:16.749977 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] For port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:13:16.754252 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:16.758637 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:16.816909 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:16.817513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:16.818866 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] 10.222.0.79 "PUT /v2.0/ports/3ad75ad9-2e01-4265-9705-f59d3e60c4e7 HTTP/1.1" status: 200  len: 1093 time: 1.1952920
Jun 01 11:13:16.819351 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '387c95c0-3fa6-40c5-8f8c-3b00df516718', 'tag': '3ad75ad9-2e01-4265-9705-f59d3e60c4e7'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:16.822208 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ebd2cea-07f7-4efd-afbb-ff0319177773" -d '{"events": [{"name": "network-changed", "server_uuid": "387c95c0-3fa6-40c5-8f8c-3b00df516718", "tag": "3ad75ad9-2e01-4265-9705-f59d3e60c4e7"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:16.842732 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Pushing event updated for resources: {'Port': ['ID=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:16.845660 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:16.864428 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-523f38d4-2e5b-4964-b217-2c8ee61365b7 x-openstack-request-id: req-523f38d4-2e5b-4964-b217-2c8ee61365b7 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:16.864746 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "387c95c0-3fa6-40c5-8f8c-3b00df516718", "tag": "3ad75ad9-2e01-4265-9705-f59d3e60c4e7", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:16.865022 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-523f38d4-2e5b-4964-b217-2c8ee61365b7 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:16.865441 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '387c95c0-3fa6-40c5-8f8c-3b00df516718', 'tag': '3ad75ad9-2e01-4265-9705-f59d3e60c4e7', 'status': 'completed', 'code': 200}
Jun 01 11:13:16.946402 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-611b801d-7578-4b11-9e52-50c7294a589e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:16.947929 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-611b801d-7578-4b11-9e52-50c7294a589e service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7e8afbfddd4f420185db35195f7b5d54&device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 1096 time: 0.0694995
Jun 01 11:13:17.020330 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-f5715f64-5c70-4cee-8195-57eda78ad377 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=3ad75ad9-2e01-4265-9705-f59d3e60c4e7 HTTP/1.1" status: 200  len: 217 time: 0.0634365
Jun 01 11:13:17.131907 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-798138b1-5f47-4922-b3e0-4b0a26539dd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:17.133310 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-798138b1-5f47-4922-b3e0-4b0a26539dd2 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=3d925639-91b9-4f79-8619-2a656b4099a2 HTTP/1.1" status: 200  len: 854 time: 0.0771227
Jun 01 11:13:17.182435 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-1822079a-764d-48c4-a10f-7e5c42cb62dc service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=73f1ca3d-3f00-45a8-bb61-3d265d008491&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0424924
Jun 01 11:13:17.190511 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a975a0-8879-41f1-99b0-cec0cbf2017e req-dbc9aaca-d3dd-45a8-afbb-4fb1d0c16e78 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:17.191862 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-04a975a0-8879-41f1-99b0-cec0cbf2017e req-dbc9aaca-d3dd-45a8-afbb-4fb1d0c16e78 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 946 time: 0.1704254
Jun 01 11:13:17.312870 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-04a975a0-8879-41f1-99b0-cec0cbf2017e req-18773f0a-8855-4cda-a55d-fe76bd1c24d5 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1034832
Jun 01 11:13:17.348296 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-d5c15ba6-21de-4eac-9f55-1b0001ce543e service neutron] 10.222.0.79 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1554782
Jun 01 11:13:17.486034 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17c365e8-1a0b-4799-9d68-b5ae942a5fff req-29998bc3-ef71-49fc-8946-7e612dc9d7ae service neutron] 10.222.0.79 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1308877
Jun 01 11:13:17.641735 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9219561-c26f-45aa-b89f-2301c20ac8fe req-379fb68c-6289-44d1-81f6-57ae1a20227b tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:17.643204 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c9219561-c26f-45aa-b89f-2301c20ac8fe req-379fb68c-6289-44d1-81f6-57ae1a20227b tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 943 time: 0.1479912
Jun 01 11:13:17.646126 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-4812754d-077e-445c-b091-ec4fbca6da84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:17.647504 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-4812754d-077e-445c-b091-ec4fbca6da84 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7e8afbfddd4f420185db35195f7b5d54&device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 1096 time: 0.1025467
Jun 01 11:13:17.766663 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c9219561-c26f-45aa-b89f-2301c20ac8fe req-286349df-5288-4195-bf49-ba3fca2d16f7 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1173139
Jun 01 11:13:17.825741 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-3b44ebf8-3766-4215-b374-97cf6dd8b119 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:17.827163 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-3b44ebf8-3766-4215-b374-97cf6dd8b119 service neutron] 10.222.0.79 "GET /v2.0/networks?id=73f1ca3d-3f00-45a8-bb61-3d265d008491 HTTP/1.1" status: 200  len: 915 time: 0.1626737
Jun 01 11:13:17.898368 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-f6d4cab5-25d9-413e-9f32-aa862bed5998 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=3ad75ad9-2e01-4265-9705-f59d3e60c4e7 HTTP/1.1" status: 200  len: 217 time: 0.0644093
Jun 01 11:13:17.963886 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-3cf5b810-5e48-4472-a90a-971266c4ba24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:17.965262 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-3cf5b810-5e48-4472-a90a-971266c4ba24 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=3d925639-91b9-4f79-8619-2a656b4099a2 HTTP/1.1" status: 200  len: 854 time: 0.0591464
Jun 01 11:13:18.100080 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-0eab0478-014b-45fa-919b-c8f304907203 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=73f1ca3d-3f00-45a8-bb61-3d265d008491&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1248090
Jun 01 11:13:18.229299 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-e55b60ad-4300-49a7-8807-d32de5ed9254 service neutron] 10.222.0.79 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1218472
Jun 01 11:13:18.360006 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ebd2cea-07f7-4efd-afbb-ff0319177773 req-7723224d-7aa7-4527-819e-5849fdeabc26 service neutron] 10.222.0.79 "GET /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1237266
Jun 01 11:13:18.950620 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adef931d-a327-4524-96f2-79e6834245d4 req-fca5e337-cccc-4e40-a574-6b2d7d40d79f tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:18.952155 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-adef931d-a327-4524-96f2-79e6834245d4 req-fca5e337-cccc-4e40-a574-6b2d7d40d79f tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 943 time: 0.0790973
Jun 01 11:13:19.000477 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-adef931d-a327-4524-96f2-79e6834245d4 req-4e208370-caf2-44af-8066-b4c1ba8942cd tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429232
Jun 01 11:13:20.183204 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca179fdd-e4a3-4bc0-a22e-033b574eba5c req-db386057-5f7e-4581-acf6-fa15e1e06d50 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:20.184698 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ca179fdd-e4a3-4bc0-a22e-033b574eba5c req-db386057-5f7e-4581-acf6-fa15e1e06d50 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 943 time: 0.0787280
Jun 01 11:13:20.228341 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ca179fdd-e4a3-4bc0-a22e-033b574eba5c req-b5494da4-3b1e-440d-bb95-d2428c611fd6 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0375438
Jun 01 11:13:20.287166 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:13:20.421606 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:20.435436 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '3ad75ad9-2e01-4265-9705-f59d3e60c4e7', 'network_id': '73f1ca3d-3f00-45a8-bb61-3d265d008491', 'port_id': '3ad75ad9-2e01-4265-9705-f59d3e60c4e7', 'mac_address': 'fa:16:3e:82:6d:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 685, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3d925639-91b9-4f79-8619-2a656b4099a2', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:13:20.488713 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:20.505341 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:13:20.520847 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:20.525337 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:20.527185 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:20.593143 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:20.595908 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:20.798070 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['3ad75ad9-2e01-4265-9705-f59d3e60c4e7'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:13:21.414001 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2636b451-dd08-49a0-88fc-7f609b4552a0 req-28c27e3b-869f-481b-9d07-cc8d9512a900 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:21.415695 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2636b451-dd08-49a0-88fc-7f609b4552a0 req-28c27e3b-869f-481b-9d07-cc8d9512a900 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 944 time: 0.0817986
Jun 01 11:13:21.459772 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2636b451-dd08-49a0-88fc-7f609b4552a0 req-d2011762-c221-4ed3-9a29-a9d784307d90 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377798
Jun 01 11:13:22.319844 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:13:22.388374 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:13:22.392859 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:13:22.393229 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:22.506413 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:22.533305 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '387c95c0-3fa6-40c5-8f8c-3b00df516718', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ad75ad9-2e01-4265-9705-f59d3e60c4e7'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:22.535512 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df8ac94f-8702-48a7-a8ac-1743c23ec9bf" -d '{"events": [{"server_uuid": "387c95c0-3fa6-40c5-8f8c-3b00df516718", "name": "network-vif-plugged", "status": "completed", "tag": "3ad75ad9-2e01-4265-9705-f59d3e60c4e7"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:22.542915 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:22.549048 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:22.551461 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:22.588626 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a1dc379-5d3d-453c-8ba2-4fd41933c2be x-openstack-request-id: req-9a1dc379-5d3d-453c-8ba2-4fd41933c2be {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:22.588924 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "387c95c0-3fa6-40c5-8f8c-3b00df516718", "name": "network-vif-plugged", "status": "completed", "tag": "3ad75ad9-2e01-4265-9705-f59d3e60c4e7", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:22.589181 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-9a1dc379-5d3d-453c-8ba2-4fd41933c2be {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:22.589569 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '387c95c0-3fa6-40c5-8f8c-3b00df516718', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ad75ad9-2e01-4265-9705-f59d3e60c4e7', 'code': 200}
Jun 01 11:13:22.623892 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:22.627531 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:22.667716 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8402c45-13bc-4c31-a0dd-fa4bae7ceaf7 req-82d0c2ad-32fc-461f-9d09-5d0f46b6a9e9 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:22.669447 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b8402c45-13bc-4c31-a0dd-fa4bae7ceaf7 req-82d0c2ad-32fc-461f-9d09-5d0f46b6a9e9 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 945 time: 0.1012912
Jun 01 11:13:22.709056 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-5d4c290c-c875-477f-a303-75d08e5c1a94 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:22.725382 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b8402c45-13bc-4c31-a0dd-fa4bae7ceaf7 req-c1f07023-4899-4a11-a02d-4e576c6590dc tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0499020
Jun 01 11:13:22.842323 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66352a7c-e348-46d7-86b6-4ac74b07a75f req-b7773594-b34c-466f-aebf-b9c83d519a67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:22.843705 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-66352a7c-e348-46d7-86b6-4ac74b07a75f req-b7773594-b34c-466f-aebf-b9c83d519a67 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 1098 time: 0.0720248
Jun 01 11:13:22.890743 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-66352a7c-e348-46d7-86b6-4ac74b07a75f req-aea9db01-baa7-470c-8cb4-3b406a2bdfbe service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0334125
Jun 01 11:13:23.911855 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-924d9f0d-f749-4c3c-aee8-e584e0bfc0b0 req-ea9dd70b-74ae-446e-a087-0c74cff874be tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:23.913323 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-924d9f0d-f749-4c3c-aee8-e584e0bfc0b0 req-ea9dd70b-74ae-446e-a087-0c74cff874be tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 945 time: 0.0818782
Jun 01 11:13:23.962959 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-924d9f0d-f749-4c3c-aee8-e584e0bfc0b0 req-4fbe65a6-4a3a-416c-b2cb-7b5a2e829421 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423944
Jun 01 11:13:24.454181 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-d64c67cc-379f-4590-b705-dbbcc492e2df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:24.455630 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-d64c67cc-379f-4590-b705-dbbcc492e2df service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1137 time: 0.1297491
Jun 01 11:13:24.467006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c31c62-1f65-48d5-b62e-f72009f75723 req-a67d7ccd-f0cb-422d-bce2-fb69b5202038 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:24.468381 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d2c31c62-1f65-48d5-b62e-f72009f75723 req-a67d7ccd-f0cb-422d-bce2-fb69b5202038 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.1128469
Jun 01 11:13:24.593587 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d2c31c62-1f65-48d5-b62e-f72009f75723 req-d4c1a6c8-f9a0-4072-9d3c-4448dc64e491 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1073189
Jun 01 11:13:24.627821 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-318dedd6-2b5e-4e20-8511-ce2f1b580e7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:24.629261 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-318dedd6-2b5e-4e20-8511-ce2f1b580e7c service neutron] 10.222.0.79 "GET /v2.0/networks?id=7356920a-571e-467c-9250-df782b9d8129 HTTP/1.1" status: 200  len: 915 time: 0.1600518
Jun 01 11:13:24.733223 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-9c8878be-b560-41b6-8520-f783cbdda98b service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 1001 time: 0.0956128
Jun 01 11:13:24.795202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-bbf7f38a-1417-4ad8-9720-c109b2b8b9b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:24.796683 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-bbf7f38a-1417-4ad8-9720-c109b2b8b9b8 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=c5b015bf-9c86-450a-8cbd-8892adfddfb6 HTTP/1.1" status: 200  len: 853 time: 0.0570567
Jun 01 11:13:24.873960 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-78877eea-ab03-40b1-80c4-ef43292ecb49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:24.875392 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-78877eea-ab03-40b1-80c4-ef43292ecb49 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7356920a-571e-467c-9250-df782b9d8129&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0723929
Jun 01 11:13:25.014662 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-47b8abbb-018d-49aa-9a4e-8236bff2bd13 service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1304481
Jun 01 11:13:25.243100 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6384ca20-85a6-4982-a81a-8821afee47ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:25.283898 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b2ed0136-e342-49a0-ba42-1f8830143372 req-5d5602d0-6151-45c6-88f8-888143c77eda service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2552850
Jun 01 11:13:25.294666 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-063cd6bb-3646-4e4d-904c-42eb7237c964 req-8058a742-13aa-48eb-8aed-9610e9699125 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:25.296124 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-063cd6bb-3646-4e4d-904c-42eb7237c964 req-8058a742-13aa-48eb-8aed-9610e9699125 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 945 time: 0.1736956
Jun 01 11:13:25.316811 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:25.346492 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-063cd6bb-3646-4e4d-904c-42eb7237c964 req-b88b7123-9539-40a6-b4fb-a3f7e5ec13e3 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433586
Jun 01 11:13:25.806657 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9baca56e-ebaf-4e6e-8f71-d05ca676a6f5 req-fc9afee0-8f2f-4f01-af4b-d60bfe91acb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:25.808450 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9baca56e-ebaf-4e6e-8f71-d05ca676a6f5 req-fc9afee0-8f2f-4f01-af4b-d60bfe91acb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.1073723
Jun 01 11:13:25.863174 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9baca56e-ebaf-4e6e-8f71-d05ca676a6f5 req-e0a7c262-5281-4469-a502-0fd9b3f35fee tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0479417
Jun 01 11:13:26.389443 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:27.056497 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a3b5328-d38e-4757-bcaa-d947c9973cb4 req-6e6dc290-95c1-4201-bca9-11c090a61c98 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:27.057952 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2a3b5328-d38e-4757-bcaa-d947c9973cb4 req-6e6dc290-95c1-4201-bca9-11c090a61c98 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0849130
Jun 01 11:13:27.106171 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2a3b5328-d38e-4757-bcaa-d947c9973cb4 req-33020544-4d31-48db-ac8d-bcc74d8a0461 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0414507
Jun 01 11:13:27.293305 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-b5f50c0d-3cf8-4017-ab07-d58b8631ffda tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:27.294649 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-b5f50c0d-3cf8-4017-ab07-d58b8631ffda tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 815 time: 0.1435347
Jun 01 11:13:27.309023 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-f59070dc-a6ca-4675-91ee-8f64f42be16b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/quotas/a83ba65361364d0fad1aa55a0f8cb7cf HTTP/1.1" status: 200  len: 375 time: 0.0089664
Jun 01 11:13:27.387445 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-eb59ecdf-0147-4e1c-938f-aebd6321b499 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&fields=id HTTP/1.1" status: 200  len: 255 time: 0.0734863
Jun 01 11:13:27.518957 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-7c8df937-3925-40f3-acc2-0040ac7ef815 service neutron] 10.222.0.74 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1249225
Jun 01 11:13:27.648714 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-059f6f34-a179-4b19-9481-63067831d0b3 service neutron] 10.222.0.74 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1239202
Jun 01 11:13:27.731951 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:27.826552 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4a1e1c8e-17f3-4d35-bc1a-2538c31690a8 req-7fd69339-4d99-4b41-a774-d5b67270e2ba tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 210 time: 0.0429919
Jun 01 11:13:28.300201 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a20212a0-4aa8-4aa9-bd58-bba3ccd26e90 req-aff15c57-752f-4d1c-ac01-21e9f1801042 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:28.301665 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a20212a0-4aa8-4aa9-bd58-bba3ccd26e90 req-aff15c57-752f-4d1c-ac01-21e9f1801042 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0881155
Jun 01 11:13:28.353501 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a20212a0-4aa8-4aa9-bd58-bba3ccd26e90 req-9d66410d-cf99-4120-ac71-5fb46251852a tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0441103
Jun 01 11:13:28.992105 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5592702e-4e32-44a6-a6e5-854ffd1d46a6 req-93cee3fe-bef7-44f3-afaf-20c33717b327 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 210 time: 0.0544481
Jun 01 11:13:29.001631 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-23f72aec-a425-4050-8b8e-ddb38fda295c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:29.002999 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-23f72aec-a425-4050-8b8e-ddb38fda295c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 815 time: 0.1875129
Jun 01 11:13:29.019273 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Request body: {'port': {'device_id': '02d71b67-8490-4a0f-97e2-e1f3cd31cc8d', 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793', 'admin_state_up': True, 'tenant_id': 'a83ba65361364d0fad1aa55a0f8cb7cf'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:29.155019 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:29.164497 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:29.174671 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Made reservation on behalf of a83ba65361364d0fad1aa55a0f8cb7cf for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:13:29.178104 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:29.339420 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Allocated IP 172.20.0.14 (10ec91f8-5d7c-496e-a32a-4dcea0b24793/6ccfaae8-bb7e-4cdd-ba83-2bee1577d247/121e5d5e-fe75-481f-9882-768f112ee1f8) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:13:29.673717 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:29.688818 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ba4b7b-d34b-4539-b49c-2e3950b73141 req-d5461e89-50ff-4a2c-96d9-cb6edb9e7bfe tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:29.690298 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-87ba4b7b-d34b-4539-b49c-2e3950b73141 req-d5461e89-50ff-4a2c-96d9-cb6edb9e7bfe tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.1957049
Jun 01 11:13:29.748863 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-87ba4b7b-d34b-4539-b49c-2e3950b73141 req-6e43546f-7ebf-47c7-9c7e-d641271158cb tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0525017
Jun 01 11:13:29.754439 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:29.760271 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:29.775525 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['7d85ff7b-1fb9-4870-919d-49ce962b290b'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:13:29.825976 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:13:29.829134 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:13:29.832996 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:13:29.863660 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Pushing event updated for resources: {'Port': ['ID=121e5d5e-fe75-481f-9882-768f112ee1f8,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:29.882804 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.883177 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.883544 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.883932 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.884289 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.885090 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.885446 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.885797 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.886152 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.886532 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.886877 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.887224 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:29.893405 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:29.912725 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:29.913332 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:29.938341 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9229090
Jun 01 11:13:29.954693 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Request body: {'port': {'device_id': '02d71b67-8490-4a0f-97e2-e1f3cd31cc8d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:30.065570 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:30.290999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f2abf6-b4c2-4d46-a0e8-905e03c69481 req-c2358687-8b51-4bea-943c-d32802941b0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:30.291718 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-29f2abf6-b4c2-4d46-a0e8-905e03c69481 req-c2358687-8b51-4bea-943c-d32802941b0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Synchronizing usage tracker for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:13:30.365655 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-29f2abf6-b4c2-4d46-a0e8-905e03c69481 req-c2358687-8b51-4bea-943c-d32802941b0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Unset dirty status for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:13:30.366779 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-29f2abf6-b4c2-4d46-a0e8-905e03c69481 req-c2358687-8b51-4bea-943c-d32802941b0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 932 time: 0.2624829
Jun 01 11:13:30.444515 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-29f2abf6-b4c2-4d46-a0e8-905e03c69481 req-a1c3f0eb-74e1-4fb8-ae5e-4a631da5b635 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0711246
Jun 01 11:13:30.512630 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 121e5d5e-fe75-481f-9882-768f112ee1f8 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:13:30.519574 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:30.533903 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Transition to ACTIVE for port object 121e5d5e-fe75-481f-9882-768f112ee1f8 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:13:30.537040 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:30.541468 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a23f3946-6b8b-4cbe-a7b0-f4d644ad481c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:30.692576 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Pushing event updated for resources: {'Port': ['ID=121e5d5e-fe75-481f-9882-768f112ee1f8,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:30.703018 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:30.767781 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Attempting to bind port 121e5d5e-fe75-481f-9882-768f112ee1f8 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:13:30.768111 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Attempting to bind port 121e5d5e-fe75-481f-9882-768f112ee1f8 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:13:30.768438 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Attempting to bind port 121e5d5e-fe75-481f-9882-768f112ee1f8 on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:13:30.773063 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Port 121e5d5e-fe75-481f-9882-768f112ee1f8 on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:13:30.773387 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Attempting to bind port 121e5d5e-fe75-481f-9882-768f112ee1f8 on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:13:30.779127 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 13, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:13:30.779352 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Checking segment: {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:13:30.779741 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Bound using segment: {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:13:30.780170 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Bound port: 121e5d5e-fe75-481f-9882-768f112ee1f8, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:13:30.780517 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:30.911475 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] For port 121e5d5e-fe75-481f-9882-768f112ee1f8, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:13:30.926543 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] For port 121e5d5e-fe75-481f-9882-768f112ee1f8, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=121e5d5e-fe75-481f-9882-768f112ee1f8,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:13:30.931655 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:30.935128 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:30.998380 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:30.998982 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:31.000362 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] 10.222.0.79 "PUT /v2.0/ports/121e5d5e-fe75-481f-9882-768f112ee1f8 HTTP/1.1" status: 200  len: 1094 time: 1.0497763
Jun 01 11:13:31.000979 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '02d71b67-8490-4a0f-97e2-e1f3cd31cc8d', 'tag': '121e5d5e-fe75-481f-9882-768f112ee1f8'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:31.003201 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d06170ec-85b7-409f-952c-f4b2e18ea71a" -d '{"events": [{"name": "network-changed", "server_uuid": "02d71b67-8490-4a0f-97e2-e1f3cd31cc8d", "tag": "121e5d5e-fe75-481f-9882-768f112ee1f8"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:31.029116 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e750c5e-2b56-4295-a8ed-7f406f42d1fe req-a3ed9b2e-3c52-4870-8b11-a9faa03cebeb tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:31.030671 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3e750c5e-2b56-4295-a8ed-7f406f42d1fe req-a3ed9b2e-3c52-4870-8b11-a9faa03cebeb tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.1721401
Jun 01 11:13:31.034644 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Pushing event updated for resources: {'Port': ['ID=121e5d5e-fe75-481f-9882-768f112ee1f8,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:31.037657 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:31.058576 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f8db221-44cc-4cf6-9ecc-8da36eed0de2 x-openstack-request-id: req-5f8db221-44cc-4cf6-9ecc-8da36eed0de2 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:31.058894 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "02d71b67-8490-4a0f-97e2-e1f3cd31cc8d", "tag": "121e5d5e-fe75-481f-9882-768f112ee1f8", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:31.059175 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-5f8db221-44cc-4cf6-9ecc-8da36eed0de2 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:31.059900 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '02d71b67-8490-4a0f-97e2-e1f3cd31cc8d', 'tag': '121e5d5e-fe75-481f-9882-768f112ee1f8', 'status': 'completed', 'code': 200}
Jun 01 11:13:31.133954 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3e750c5e-2b56-4295-a8ed-7f406f42d1fe req-729c1141-e49a-47c4-a6c5-afda71ffef7d tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0924137
Jun 01 11:13:31.155221 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-d08dbcef-b8e6-4be5-bad6-01ac270b0c50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:31.156686 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-d08dbcef-b8e6-4be5-bad6-01ac270b0c50 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 1097 time: 0.0938747
Jun 01 11:13:31.309102 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-fbbc38a1-f486-40f0-af76-a959680f857b service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=121e5d5e-fe75-481f-9882-768f112ee1f8 HTTP/1.1" status: 200  len: 217 time: 0.1417103
Jun 01 11:13:31.372760 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-90e72e13-cf62-44d5-92c4-3f85bb25f39d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:31.374176 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-90e72e13-cf62-44d5-92c4-3f85bb25f39d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 HTTP/1.1" status: 200  len: 855 time: 0.0572729
Jun 01 11:13:31.423677 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-47e93f1c-deb2-4249-a745-b0fd8bcda173 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=10ec91f8-5d7c-496e-a32a-4dcea0b24793&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0399139
Jun 01 11:13:31.605032 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-3f098394-0b0b-4b84-a413-324f4c07e3b8 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1655211
Jun 01 11:13:31.740315 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4493d2-554f-4d02-b108-45a1b864b933 req-3bfda275-e67b-4708-9f80-2dce58b29450 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:31.741760 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5a4493d2-554f-4d02-b108-45a1b864b933 req-3bfda275-e67b-4708-9f80-2dce58b29450 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 944 time: 0.1869922
Jun 01 11:13:31.778695 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5a544df-4820-405a-b395-dec97bca5fc5 req-6a8f5e61-cf8a-4b2f-a42f-10efdd3399fd service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1638024
Jun 01 11:13:31.799818 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5a4493d2-554f-4d02-b108-45a1b864b933 req-d8dc2829-8827-4f40-87d0-4c56d33f74f4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448918
Jun 01 11:13:31.916905 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-64c7cf4a-43fc-41b2-887d-6a0af2065829 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:31.918381 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-64c7cf4a-43fc-41b2-887d-6a0af2065829 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 1097 time: 0.0699725
Jun 01 11:13:32.053539 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-4ce66fcf-dcf2-4149-9692-0d43180712fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:32.054959 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-4ce66fcf-dcf2-4149-9692-0d43180712fe service neutron] 10.222.0.79 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 916 time: 0.1246023
Jun 01 11:13:32.135751 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-bb9deac1-dbc1-4216-863a-ba8796121f1d service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=121e5d5e-fe75-481f-9882-768f112ee1f8 HTTP/1.1" status: 200  len: 217 time: 0.0630658
Jun 01 11:13:32.206184 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-73d07f98-6f52-4e60-b828-87ae4c322799 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:32.207623 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-73d07f98-6f52-4e60-b828-87ae4c322799 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 HTTP/1.1" status: 200  len: 855 time: 0.0570469
Jun 01 11:13:32.294984 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-46062ea5-2669-41e5-b090-f8a4aec36ddc service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=10ec91f8-5d7c-496e-a32a-4dcea0b24793&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0726640
Jun 01 11:13:32.443049 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34765c28-dae1-4cdc-bfc6-59693eaf3b3f req-8a6846b5-cb3a-420f-8900-1d595727019c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:32.444571 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-34765c28-dae1-4cdc-bfc6-59693eaf3b3f req-8a6846b5-cb3a-420f-8900-1d595727019c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.1854339
Jun 01 11:13:32.478499 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-826d3ed6-e9dd-4f13-b129-8d9d84f8f829 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1695178
Jun 01 11:13:32.526397 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-34765c28-dae1-4cdc-bfc6-59693eaf3b3f req-01af2b3b-b19f-4047-bc7e-90eddcdd58a6 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0721719
Jun 01 11:13:32.628861 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d06170ec-85b7-409f-952c-f4b2e18ea71a req-0a58f467-78c6-4565-a48d-847624225a36 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1340675
Jun 01 11:13:32.988112 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec75b397-dcc1-4eb8-991a-7fde0a4b37c4 req-066551e1-1d2f-4513-8867-8c14282a6ed7 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:32.989458 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ec75b397-dcc1-4eb8-991a-7fde0a4b37c4 req-066551e1-1d2f-4513-8867-8c14282a6ed7 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 944 time: 0.0845466
Jun 01 11:13:33.034898 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ec75b397-dcc1-4eb8-991a-7fde0a4b37c4 req-5de9dc7f-e9cc-4720-8a47-40a9b0415190 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397489
Jun 01 11:13:33.734892 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91ce0753-6367-4031-954a-82d925a83ad9 req-623a73f0-4921-4e67-b953-a4832bebb76f tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:33.736623 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-91ce0753-6367-4031-954a-82d925a83ad9 req-623a73f0-4921-4e67-b953-a4832bebb76f tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0915127
Jun 01 11:13:33.790895 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-91ce0753-6367-4031-954a-82d925a83ad9 req-26a95d46-958f-4883-8d27-30ff8278a641 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0479255
Jun 01 11:13:34.217517 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00f9bb07-66f6-4bbb-90b7-72b4fcf946ab req-8c889d16-4e82-44a7-8b5b-3aba9cbbc74e tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:34.218955 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-00f9bb07-66f6-4bbb-90b7-72b4fcf946ab req-8c889d16-4e82-44a7-8b5b-3aba9cbbc74e tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 944 time: 0.0793858
Jun 01 11:13:34.261816 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-00f9bb07-66f6-4bbb-90b7-72b4fcf946ab req-20d5651c-7af3-4d6d-824c-9e59194ca6db tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373354
Jun 01 11:13:34.987036 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc00877-2638-44df-b35c-0a7e1a7bf66f req-b4dd3c59-b49a-432b-95cb-2f46450fcea1 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:34.988467 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3dc00877-2638-44df-b35c-0a7e1a7bf66f req-b4dd3c59-b49a-432b-95cb-2f46450fcea1 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0872722
Jun 01 11:13:35.119726 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3dc00877-2638-44df-b35c-0a7e1a7bf66f req-16e92550-a5fa-46de-acfe-5ed2ddc1e537 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1254261
Jun 01 11:13:35.333555 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 121e5d5e-fe75-481f-9882-768f112ee1f8 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:13:35.449103 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-895bee3c-7d74-4589-81cf-4959e118577b req-78f8e005-e79c-463e-84b7-f97e92871b63 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:35.451146 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-895bee3c-7d74-4589-81cf-4959e118577b req-78f8e005-e79c-463e-84b7-f97e92871b63 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 944 time: 0.0861866
Jun 01 11:13:35.471285 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 121e5d5e-fe75-481f-9882-768f112ee1f8, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=121e5d5e-fe75-481f-9882-768f112ee1f8,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:35.484740 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '121e5d5e-fe75-481f-9882-768f112ee1f8', 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793', 'port_id': '121e5d5e-fe75-481f-9882-768f112ee1f8', 'mac_address': 'fa:16:3e:04:12:36', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 682, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6ccfaae8-bb7e-4cdd-ba83-2bee1577d247', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:13:35.495698 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-895bee3c-7d74-4589-81cf-4959e118577b req-27b226c4-5def-4371-bc6b-a563a9e511af tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385120
Jun 01 11:13:35.570582 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:35.586319 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 121e5d5e-fe75-481f-9882-768f112ee1f8 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:13:35.601020 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 121e5d5e-fe75-481f-9882-768f112ee1f8, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=121e5d5e-fe75-481f-9882-768f112ee1f8,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:35.604722 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:35.606423 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:35.669733 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=121e5d5e-fe75-481f-9882-768f112ee1f8,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:35.672588 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:36.304750 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-542bc7b7-5531-4d4e-8c6f-70d84c4467d1 req-5c0e7efe-0e4c-40e9-8bd7-546d0bb1d271 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:36.306189 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-542bc7b7-5531-4d4e-8c6f-70d84c4467d1 req-5c0e7efe-0e4c-40e9-8bd7-546d0bb1d271 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0820529
Jun 01 11:13:36.353298 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-542bc7b7-5531-4d4e-8c6f-70d84c4467d1 req-360c3a3e-e741-4dec-a5bb-b1543050faf2 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0411005
Jun 01 11:13:36.679028 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a0292a-70eb-40c0-b842-7604657a4982 req-846200ad-5100-4f7a-9459-dc665c20018e tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:36.680479 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d9a0292a-70eb-40c0-b842-7604657a4982 req-846200ad-5100-4f7a-9459-dc665c20018e tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 945 time: 0.0804431
Jun 01 11:13:36.734138 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d9a0292a-70eb-40c0-b842-7604657a4982 req-f7ca5c3f-5f30-4582-843b-fb7919d15fed tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0458868
Jun 01 11:13:37.533117 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f25c9b-2c16-41e6-b60d-d422c1893b2a req-78a65ab1-d804-4bdd-ba3d-21da535fbaee tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:37.534536 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-11f25c9b-2c16-41e6-b60d-d422c1893b2a req-78a65ab1-d804-4bdd-ba3d-21da535fbaee tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0786824
Jun 01 11:13:37.580571 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-11f25c9b-2c16-41e6-b60d-d422c1893b2a req-be732878-861a-45a7-9d1b-18915cb61ec4 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0402665
Jun 01 11:13:37.717302 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['121e5d5e-fe75-481f-9882-768f112ee1f8'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:13:37.920990 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab7ab763-304f-4bcb-819c-075abafcdfc8 req-3541aedf-a4f1-4e66-aed1-85d485d8e1c0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:37.922415 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ab7ab763-304f-4bcb-819c-075abafcdfc8 req-3541aedf-a4f1-4e66-aed1-85d485d8e1c0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 945 time: 0.0841844
Jun 01 11:13:37.965506 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ab7ab763-304f-4bcb-819c-075abafcdfc8 req-1bf88184-6a2b-4148-9cb0-6165bac99eab tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373654
Jun 01 11:13:38.769784 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2559367-9a72-4cb8-87df-2b290c1f662d req-eab96014-add7-40b0-a5de-80626dad6028 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:38.771213 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a2559367-9a72-4cb8-87df-2b290c1f662d req-eab96014-add7-40b0-a5de-80626dad6028 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0786469
Jun 01 11:13:38.816117 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a2559367-9a72-4cb8-87df-2b290c1f662d req-fbf23675-05ba-40a3-995b-7395440a2f38 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0391369
Jun 01 11:13:39.155279 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44398055-85d7-45ce-a474-e086e3d5f0ed req-d191799c-a916-422b-b746-c05ca9adecc3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:39.156743 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-44398055-85d7-45ce-a474-e086e3d5f0ed req-d191799c-a916-422b-b746-c05ca9adecc3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 945 time: 0.0842097
Jun 01 11:13:39.200343 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-44398055-85d7-45ce-a474-e086e3d5f0ed req-13cec326-85fe-4157-8083-4f6eec8716ac tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380414
Jun 01 11:13:39.999404 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8493c3-8d2b-452e-82f3-7fdc13751161 req-529d48b5-a44f-4950-8662-9b8db09065d7 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:40.000788 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7a8493c3-8d2b-452e-82f3-7fdc13751161 req-529d48b5-a44f-4950-8662-9b8db09065d7 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0782983
Jun 01 11:13:40.049909 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7a8493c3-8d2b-452e-82f3-7fdc13751161 req-826d677c-0e74-481d-8cda-5fd5e1255b8f tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0434332
Jun 01 11:13:40.383368 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbeb3f9f-0373-48a7-9399-35b04f3e8fa4 req-8796cd48-9fea-4082-bf4d-70100d966e5f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:40.385108 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fbeb3f9f-0373-48a7-9399-35b04f3e8fa4 req-8796cd48-9fea-4082-bf4d-70100d966e5f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 945 time: 0.0798967
Jun 01 11:13:40.430620 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fbeb3f9f-0373-48a7-9399-35b04f3e8fa4 req-3ab0ba75-82bf-47b3-9e65-5276d184d04a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392609
Jun 01 11:13:41.235065 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c8df97-3968-4fe1-8696-5d9a3864415a req-3769bae2-243f-40d4-845e-c36b99a4e460 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:41.236522 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-40c8df97-3968-4fe1-8696-5d9a3864415a req-3769bae2-243f-40d4-845e-c36b99a4e460 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0834367
Jun 01 11:13:41.282062 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-40c8df97-3968-4fe1-8696-5d9a3864415a req-7830ad42-3aa6-41e2-8647-cc4f36b58da6 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0398629
Jun 01 11:13:41.613401 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b33c5b7f-c216-43ab-8667-2edf0cda23d4 req-46f316d9-21e3-4fa0-b98b-4c422e2037a0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:41.614872 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b33c5b7f-c216-43ab-8667-2edf0cda23d4 req-46f316d9-21e3-4fa0-b98b-4c422e2037a0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 945 time: 0.0802708
Jun 01 11:13:41.660404 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b33c5b7f-c216-43ab-8667-2edf0cda23d4 req-db494231-855d-48e1-ad35-4b05f627419e tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395937
Jun 01 11:13:42.469817 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac71f220-bc19-432c-9b8b-eaf88835c4d7 req-308594bc-5b57-49c8-9d03-2b77bed26b1d tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:42.471296 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ac71f220-bc19-432c-9b8b-eaf88835c4d7 req-308594bc-5b57-49c8-9d03-2b77bed26b1d tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0842404
Jun 01 11:13:42.518453 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ac71f220-bc19-432c-9b8b-eaf88835c4d7 req-c82b1dac-8e7a-42af-b884-202b6d44fae3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0412335
Jun 01 11:13:42.843941 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3aa9b8-1a92-4fe9-897c-0b1a8951de0e req-a46c8e36-dd71-4b6f-9903-3b3e374f36c6 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:42.845278 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5b3aa9b8-1a92-4fe9-897c-0b1a8951de0e req-a46c8e36-dd71-4b6f-9903-3b3e374f36c6 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 945 time: 0.0784686
Jun 01 11:13:42.889715 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5b3aa9b8-1a92-4fe9-897c-0b1a8951de0e req-ec1b3a42-486b-4288-a1ff-3af700a5bdea tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388858
Jun 01 11:13:43.424172 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 121e5d5e-fe75-481f-9882-768f112ee1f8 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:13:43.489976 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 121e5d5e-fe75-481f-9882-768f112ee1f8 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:13:43.494453 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 121e5d5e-fe75-481f-9882-768f112ee1f8 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:13:43.494826 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:43.617597 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:43.646108 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02d71b67-8490-4a0f-97e2-e1f3cd31cc8d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '121e5d5e-fe75-481f-9882-768f112ee1f8'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:43.648468 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-24504c0b-904d-49bf-b28c-690aa9838061" -d '{"events": [{"server_uuid": "02d71b67-8490-4a0f-97e2-e1f3cd31cc8d", "name": "network-vif-plugged", "status": "completed", "tag": "121e5d5e-fe75-481f-9882-768f112ee1f8"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:43.656029 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 121e5d5e-fe75-481f-9882-768f112ee1f8, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=121e5d5e-fe75-481f-9882-768f112ee1f8,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:43.662548 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:43.664882 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:43.706898 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9329420e-3d82-4233-a6c1-908c3e85955a x-openstack-request-id: req-9329420e-3d82-4233-a6c1-908c3e85955a {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:43.707093 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02d71b67-8490-4a0f-97e2-e1f3cd31cc8d", "name": "network-vif-plugged", "status": "completed", "tag": "121e5d5e-fe75-481f-9882-768f112ee1f8", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:43.707438 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-9329420e-3d82-4233-a6c1-908c3e85955a {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:43.708127 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02d71b67-8490-4a0f-97e2-e1f3cd31cc8d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '121e5d5e-fe75-481f-9882-768f112ee1f8', 'code': 200}
Jun 01 11:13:43.734759 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01cbb009-2ae0-4c41-acc9-3e9084af74cc req-c858e16c-46e0-40c9-8024-4931e571dda0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:43.736349 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-01cbb009-2ae0-4c41-acc9-3e9084af74cc req-c858e16c-46e0-40c9-8024-4931e571dda0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.1097727
Jun 01 11:13:43.747247 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=121e5d5e-fe75-481f-9882-768f112ee1f8,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:43.758785 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:43.789203 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-01cbb009-2ae0-4c41-acc9-3e9084af74cc req-db3751b5-dd83-4eb1-8ad1-3c02b444ec86 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0442321
Jun 01 11:13:44.074906 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-807d6a5a-a6b2-4ab3-b992-31cfc3b5837b req-987c658d-b7a4-4ed4-a56e-f878f4b96201 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:44.076322 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-807d6a5a-a6b2-4ab3-b992-31cfc3b5837b req-987c658d-b7a4-4ed4-a56e-f878f4b96201 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 946 time: 0.0816135
Jun 01 11:13:44.123457 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-807d6a5a-a6b2-4ab3-b992-31cfc3b5837b req-a99dc003-de81-4204-93b3-a7dcd1652332 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415344
Jun 01 11:13:44.837431 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91b5c35-721a-485f-bf86-b14c455f6054 req-92890cc8-2ea2-4e6f-bfc8-448b0f42f042 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:44.838884 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a91b5c35-721a-485f-bf86-b14c455f6054 req-92890cc8-2ea2-4e6f-bfc8-448b0f42f042 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 1099 time: 0.0702832
Jun 01 11:13:44.879363 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a91b5c35-721a-485f-bf86-b14c455f6054 req-2cbc68f8-ad42-4d6f-920e-2c77199f7bec service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0338628
Jun 01 11:13:44.973933 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6782726-dae6-4013-be90-433fc8c84d98 req-1139ac27-39ad-43c8-b704-59929c37423b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:44.975274 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f6782726-dae6-4013-be90-433fc8c84d98 req-1139ac27-39ad-43c8-b704-59929c37423b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0817814
Jun 01 11:13:45.021332 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f6782726-dae6-4013-be90-433fc8c84d98 req-a51f1dbd-55fe-4238-b5b9-6b685422a575 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0404036
Jun 01 11:13:45.303029 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7479865e-16cf-4662-af92-4715cdce64ad req-49a88ffb-3c0c-43e7-8bec-a5f79fc63099 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:45.304369 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7479865e-16cf-4662-af92-4715cdce64ad req-49a88ffb-3c0c-43e7-8bec-a5f79fc63099 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 946 time: 0.0802557
Jun 01 11:13:45.348367 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7479865e-16cf-4662-af92-4715cdce64ad req-93866828-991d-4580-894b-8c85ead15f6c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384543
Jun 01 11:13:46.326743 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb36e34b-2c0e-4406-95a7-2a7a1e99788a req-32d50ba4-3dc7-49b4-9e33-d8192af51961 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:46.328154 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bb36e34b-2c0e-4406-95a7-2a7a1e99788a req-32d50ba4-3dc7-49b4-9e33-d8192af51961 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.1981595
Jun 01 11:13:46.374883 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bb36e34b-2c0e-4406-95a7-2a7a1e99788a req-cc93ae48-0f7c-4a72-aa6a-a7a2fa62e65e tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0410402
Jun 01 11:13:46.534366 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcefe89-b18c-4cfb-95af-6675f11859ce req-552a51aa-792c-4cb9-8962-925c71b3626a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:46.535846 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0dcefe89-b18c-4cfb-95af-6675f11859ce req-552a51aa-792c-4cb9-8962-925c71b3626a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 946 time: 0.0813828
Jun 01 11:13:46.579298 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0dcefe89-b18c-4cfb-95af-6675f11859ce req-e64a8d62-aee2-4950-a6e0-b066d04f410f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0378509
Jun 01 11:13:46.599604 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:46.806540 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:13:47.564635 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28a70797-122c-4af6-aeff-141c7ef3d851 req-9a8cbf32-4ca1-4353-85e2-543108e63602 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:47.566084 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28a70797-122c-4af6-aeff-141c7ef3d851 req-9a8cbf32-4ca1-4353-85e2-543108e63602 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.0793657
Jun 01 11:13:47.611111 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28a70797-122c-4af6-aeff-141c7ef3d851 req-309f8b38-48d7-4c8a-9b3f-2c0e33ad2bb9 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3&id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0393047
Jun 01 11:13:48.653439 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-c3021381-3beb-495a-84cd-14bdd7c9d864 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:48.655300 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-c3021381-3beb-495a-84cd-14bdd7c9d864 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 815 time: 0.1436155
Jun 01 11:13:48.669310 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-fcaad746-2b01-4d59-9d87-0b510ca6ead7 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/quotas/a83ba65361364d0fad1aa55a0f8cb7cf HTTP/1.1" status: 200  len: 375 time: 0.0085645
Jun 01 11:13:48.756050 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-d9edb68c-808d-4797-8f8d-cfd4b7b7e71b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0808907
Jun 01 11:13:48.890624 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-6b34afaa-6557-417b-ba1d-3c25424b2642 service neutron] 10.222.0.74 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1276715
Jun 01 11:13:49.018173 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-b108370f-fac0-4e14-8738-a2c6f2305500 service neutron] 10.222.0.74 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1215491
Jun 01 11:13:49.247717 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-32067dbb-6656-43ad-97c8-d5d1cc5f54a6 req-3ddb3971-9ea3-492a-9d5d-61ba089cb12e tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 210 time: 0.0940559
Jun 01 11:13:50.005391 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a026f5d-7ff8-4884-af53-4154e9b89091 req-701c6d6b-d851-499d-bc10-b5b9685d1a31 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:50.006835 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3a026f5d-7ff8-4884-af53-4154e9b89091 req-701c6d6b-d851-499d-bc10-b5b9685d1a31 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 945 time: 0.0823472
Jun 01 11:13:50.050746 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3a026f5d-7ff8-4884-af53-4154e9b89091 req-5a42f70c-107f-425d-8612-44ab322250cf tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380099
Jun 01 11:13:50.408645 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5305c9ff-4371-4d04-b849-7d1e4b4f9416 req-1dc4c47e-80e6-4244-8ad7-201cf3c2a240 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 210 time: 0.0535419
Jun 01 11:13:50.442119 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-14e76b69-39a0-4ca9-a709-4f5dde7194eb tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:50.443518 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-14e76b69-39a0-4ca9-a709-4f5dde7194eb tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 815 time: 0.1937575
Jun 01 11:13:50.460863 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Request body: {'port': {'device_id': '30b72546-8e51-4187-b117-40d55cc14dff', 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793', 'admin_state_up': True, 'tenant_id': 'a83ba65361364d0fad1aa55a0f8cb7cf'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:50.592710 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:50.602239 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:50.612372 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Made reservation on behalf of a83ba65361364d0fad1aa55a0f8cb7cf for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:13:50.615807 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:50.775995 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Allocated IP 172.20.0.5 (10ec91f8-5d7c-496e-a32a-4dcea0b24793/6ccfaae8-bb7e-4cdd-ba83-2bee1577d247/8188fbc7-28fc-4aa3-8f48-39221c1646fb) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:13:50.971642 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:51.001156 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:51.006676 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:51.017498 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['7d85ff7b-1fb9-4870-919d-49ce962b290b', '121e5d5e-fe75-481f-9882-768f112ee1f8'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:13:51.167314 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Pushing event updated for resources: {'Port': ['ID=8188fbc7-28fc-4aa3-8f48-39221c1646fb,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:51.177168 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:51.222468 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:13:51.227983 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:13:51.234948 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:13:51.313526 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:51.314082 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:51.349464 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726bb95f-fadd-46d9-9c83-29a21861c37c req-d08cf56e-f658-4fb3-8684-6eb7f1d3377d tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:51.350949 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-726bb95f-fadd-46d9-9c83-29a21861c37c req-d08cf56e-f658-4fb3-8684-6eb7f1d3377d tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 945 time: 0.1629319
Jun 01 11:13:51.356667 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8996902
Jun 01 11:13:51.379016 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Request body: {'port': {'device_id': '30b72546-8e51-4187-b117-40d55cc14dff', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:51.447013 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-726bb95f-fadd-46d9-9c83-29a21861c37c req-81fa4e35-8470-48b7-a706-8b106c3d3fde tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0894022
Jun 01 11:13:51.510331 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:51.735654 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5c41f6-9a68-4ba7-b3fb-fe055df4fdc1 req-1b8a698d-e724-43d6-9505-ac5d8506c312 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:51.736933 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-4f5c41f6-9a68-4ba7-b3fb-fe055df4fdc1 req-1b8a698d-e724-43d6-9505-ac5d8506c312 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Synchronizing usage tracker for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:13:51.830403 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-4f5c41f6-9a68-4ba7-b3fb-fe055df4fdc1 req-1b8a698d-e724-43d6-9505-ac5d8506c312 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Unset dirty status for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:13:51.831534 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4f5c41f6-9a68-4ba7-b3fb-fe055df4fdc1 req-1b8a698d-e724-43d6-9505-ac5d8506c312 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 931 time: 0.2722545
Jun 01 11:13:51.913236 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4f5c41f6-9a68-4ba7-b3fb-fe055df4fdc1 req-5882d4d1-aaed-4228-a2e0-3f2176dc22b8 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0750198
Jun 01 11:13:51.987954 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8188fbc7-28fc-4aa3-8f48-39221c1646fb {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:13:51.995040 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:52.010794 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Transition to ACTIVE for port object 8188fbc7-28fc-4aa3-8f48-39221c1646fb will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:13:52.014251 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:52.018698 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-02935d0f-3b66-4005-a08b-844a7af00aaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:52.220195 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Pushing event updated for resources: {'Port': ['ID=8188fbc7-28fc-4aa3-8f48-39221c1646fb,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:52.228769 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:52.318795 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Attempting to bind port 8188fbc7-28fc-4aa3-8f48-39221c1646fb on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:13:52.319040 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Attempting to bind port 8188fbc7-28fc-4aa3-8f48-39221c1646fb by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:13:52.319360 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Attempting to bind port 8188fbc7-28fc-4aa3-8f48-39221c1646fb on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:13:52.330557 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-35f7b4c3-7587-4876-a8bf-abb0dcb5144d tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:52.332016 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-35f7b4c3-7587-4876-a8bf-abb0dcb5144d tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.79 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 945 time: 0.1875525
Jun 01 11:13:52.334388 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Port 8188fbc7-28fc-4aa3-8f48-39221c1646fb on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:13:52.334706 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Attempting to bind port 8188fbc7-28fc-4aa3-8f48-39221c1646fb on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:13:52.340141 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 13, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:13:52.340471 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Checking segment: {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:13:52.340844 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Bound using segment: {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:13:52.341261 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Bound port: 8188fbc7-28fc-4aa3-8f48-39221c1646fb, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:13:52.341627 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:52.538477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] For port 8188fbc7-28fc-4aa3-8f48-39221c1646fb, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:13:52.542282 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] For port 8188fbc7-28fc-4aa3-8f48-39221c1646fb, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=8188fbc7-28fc-4aa3-8f48-39221c1646fb,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:13:52.548061 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:52.553142 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d55510fd-82fb-47b7-aa66-855318d5e854 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:52.658186 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:52.658779 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:52.660129 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] 10.222.0.79 "PUT /v2.0/ports/8188fbc7-28fc-4aa3-8f48-39221c1646fb HTTP/1.1" status: 200  len: 1093 time: 1.2853451
Jun 01 11:13:52.662740 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '30b72546-8e51-4187-b117-40d55cc14dff', 'tag': '8188fbc7-28fc-4aa3-8f48-39221c1646fb'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:52.665001 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17fc5c54-4950-4504-a88f-88ef1e11a7fa" -d '{"events": [{"name": "network-changed", "server_uuid": "30b72546-8e51-4187-b117-40d55cc14dff", "tag": "8188fbc7-28fc-4aa3-8f48-39221c1646fb"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:52.669709 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Deleting port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:13:52.670808 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:52.727243 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-5ce9e5ae-dd75-47f1-a7a8-638d0354c1c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:52.769173 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1afbded7-14b3-4858-81e1-b85d7e882ab1 x-openstack-request-id: req-1afbded7-14b3-4858-81e1-b85d7e882ab1 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:52.769490 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "30b72546-8e51-4187-b117-40d55cc14dff", "tag": "8188fbc7-28fc-4aa3-8f48-39221c1646fb", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:52.769765 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-1afbded7-14b3-4858-81e1-b85d7e882ab1 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:52.770173 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '30b72546-8e51-4187-b117-40d55cc14dff', 'tag': '8188fbc7-28fc-4aa3-8f48-39221c1646fb', 'status': 'completed', 'code': 200}
Jun 01 11:13:52.906154 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Pushing event updated for resources: {'Port': ['ID=8188fbc7-28fc-4aa3-8f48-39221c1646fb,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:52.918366 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.365s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:52.990939 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] For port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,segment=NetworkSegment(04a7072a-bdf8-4e49-a012-f597df9410a5),segment_id=04a7072a-bdf8-4e49-a012-f597df9410a5)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:52.991298 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:53.006032 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7649ff5d-ba25-40e0-a4b2-e5bb06c5c112 req-0c8bd429-9517-4995-8c87-31d1eaf10a92 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:53.007471 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7649ff5d-ba25-40e0-a4b2-e5bb06c5c112 req-0c8bd429-9517-4995-8c87-31d1eaf10a92 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 945 time: 0.4191456
Jun 01 11:13:53.145947 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Calling delete_port for 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:13:53.199061 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-edc2bea1-7a88-4f0e-af55-b4c0a86e8daa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:53.200519 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-edc2bea1-7a88-4f0e-af55-b4c0a86e8daa service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 1096 time: 0.4385562
Jun 01 11:13:53.291178 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7649ff5d-ba25-40e0-a4b2-e5bb06c5c112 req-8f64cde5-5bc4-4c37-b35b-ced1353ffcb0 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/security-groups?id=b802acef-3487-4640-8b16-f6e4055e16d6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2759378
Jun 01 11:13:53.301905 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-65ca4b62-1b4d-42b0-a3dd-1fb6fb4f4418 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8188fbc7-28fc-4aa3-8f48-39221c1646fb HTTP/1.1" status: 200  len: 217 time: 0.0834653
Jun 01 11:13:53.395106 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fc62b17-8283-4776-9d7c-e8abb197bacc req-c72f77aa-44ba-49e7-a654-3e8abdbb70bd tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:53.396606 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6fc62b17-8283-4776-9d7c-e8abb197bacc req-c72f77aa-44ba-49e7-a654-3e8abdbb70bd tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 943 time: 0.2619183
Jun 01 11:13:53.441008 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-50c8abf9-a373-4f0f-8ffd-a9c5ea20d52f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:53.442343 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-50c8abf9-a373-4f0f-8ffd-a9c5ea20d52f service neutron] 10.222.0.79 "GET /v2.0/subnets?id=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 HTTP/1.1" status: 200  len: 855 time: 0.1301410
Jun 01 11:13:53.542451 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-7eba48c2-2a91-4275-b729-62defa751267 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=10ec91f8-5d7c-496e-a32a-4dcea0b24793&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0804598
Jun 01 11:13:53.649461 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6fc62b17-8283-4776-9d7c-e8abb197bacc req-79d010ab-a895-42d9-a20e-05b4e1a750a9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2154310
Jun 01 11:13:53.684973 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:53.696053 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:53.704083 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['3ad75ad9-2e01-4265-9705-f59d3e60c4e7'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:13:53.756084 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bdcadc0-9160-4212-8ff6-f76534ee4f1a req-52b21695-9d71-43ed-aaa0-aa016fba6187 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:53.757531 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bdcadc0-9160-4212-8ff6-f76534ee4f1a req-52b21695-9d71-43ed-aaa0-aa016fba6187 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 946 time: 0.3723140
Jun 01 11:13:53.773228 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Pushing event deleted for resources: {'Port': ['ID=3ad75ad9-2e01-4265-9705-f59d3e60c4e7,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:53.813931 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:53.874684 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-f02bdd88-0e0f-44a4-9b64-422a0baf32f4 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3148322
Jun 01 11:13:53.887201 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] No DVR routers for this DVR port 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:13:53.913405 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:53.932082 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bdcadc0-9160-4212-8ff6-f76534ee4f1a req-f2c9f658-90fb-495c-a94d-c795107f1048 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1632488
Jun 01 11:13:53.979053 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6ea3216d-bdbd-427c-afc2-382d54c7940c req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.79 "DELETE /v2.0/ports/3ad75ad9-2e01-4265-9705-f59d3e60c4e7 HTTP/1.1" status: 204  len: 173 time: 1.6279297
Jun 01 11:13:54.036172 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6952444e-067d-48aa-9db0-a4fbe25e218c req-5491c537-01d0-4a25-aa5b-ac067d37cba0 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1499510
Jun 01 11:13:54.179219 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-0891bbbb-bc2a-4490-a890-e629539fe031 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:54.180603 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-0891bbbb-bc2a-4490-a890-e629539fe031 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 1096 time: 0.0708523
Jun 01 11:13:54.312250 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-8574d7ff-0217-4e49-a25c-e84219e6eda2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:54.313668 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-8574d7ff-0217-4e49-a25c-e84219e6eda2 service neutron] 10.222.0.79 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 916 time: 0.1237373
Jun 01 11:13:54.393522 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-133a0856-c1c7-421f-8802-f96b10dc01c9 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8188fbc7-28fc-4aa3-8f48-39221c1646fb HTTP/1.1" status: 200  len: 217 time: 0.0647166
Jun 01 11:13:54.490803 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-2c56dd04-4a5a-4624-a605-1f6c0021d1ad req-3b385acb-c746-4429-ae6a-ca2dd5dcd7b1 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Synchronizing usage tracker for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:13:54.514497 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-aa048e24-ada8-4c47-851e-0c447951749f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:54.515879 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-aa048e24-ada8-4c47-851e-0c447951749f service neutron] 10.222.0.79 "GET /v2.0/subnets?id=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 HTTP/1.1" status: 200  len: 855 time: 0.1152294
Jun 01 11:13:54.517045 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-2c56dd04-4a5a-4624-a605-1f6c0021d1ad req-3b385acb-c746-4429-ae6a-ca2dd5dcd7b1 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Unset dirty status for tenant:7e8afbfddd4f420185db35195f7b5d54 on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:13:54.518091 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2c56dd04-4a5a-4624-a605-1f6c0021d1ad req-3b385acb-c746-4429-ae6a-ca2dd5dcd7b1 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] 10.222.0.74 "GET /v2.0/ports?device_id=387c95c0-3fa6-40c5-8f8c-3b00df516718 HTTP/1.1" status: 200  len: 210 time: 0.0884206
Jun 01 11:13:54.663574 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-313c9d81-bcab-4087-aea9-aa615e37c7e8 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=10ec91f8-5d7c-496e-a32a-4dcea0b24793&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1414189
Jun 01 11:13:54.794151 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '387c95c0-3fa6-40c5-8f8c-3b00df516718', 'name': 'network-vif-deleted', 'tag': '3ad75ad9-2e01-4265-9705-f59d3e60c4e7'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:54.796903 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4093743d-502b-4922-98a3-5447aa2559a6" -d '{"events": [{"server_uuid": "387c95c0-3fa6-40c5-8f8c-3b00df516718", "name": "network-vif-deleted", "tag": "3ad75ad9-2e01-4265-9705-f59d3e60c4e7"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:54.852196 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0578b924-dab4-4992-a492-5e61633c3893 x-openstack-request-id: req-0578b924-dab4-4992-a492-5e61633c3893 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:54.852525 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "387c95c0-3fa6-40c5-8f8c-3b00df516718", "name": "network-vif-deleted", "tag": "3ad75ad9-2e01-4265-9705-f59d3e60c4e7", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:54.852806 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-0578b924-dab4-4992-a492-5e61633c3893 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:54.853213 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '387c95c0-3fa6-40c5-8f8c-3b00df516718', 'name': 'network-vif-deleted', 'tag': '3ad75ad9-2e01-4265-9705-f59d3e60c4e7', 'status': 'completed', 'code': 200}
Jun 01 11:13:54.877449 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-4abdceae-46b7-4a5b-b926-ff9d4a0bfbaf service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1963859
Jun 01 11:13:54.894716 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd81de8e-7b9f-49cd-b530-79817e890526 req-253e5b8d-ddc2-4e9d-91c7-49ba7790f4ea tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:54.896085 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd81de8e-7b9f-49cd-b530-79817e890526 req-253e5b8d-ddc2-4e9d-91c7-49ba7790f4ea tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 943 time: 0.1350827
Jun 01 11:13:55.020625 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd81de8e-7b9f-49cd-b530-79817e890526 req-ff838903-e11b-4173-9fe5-0b88bede388d tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1060195
Jun 01 11:13:55.094406 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-17fc5c54-4950-4504-a88f-88ef1e11a7fa req-44de0f5c-3267-4cff-a4be-7dcf2ffd1876 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1972983
Jun 01 11:13:55.131306 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ddb7d8-8bcf-46af-b4f2-5abd2f6db303 req-b513fb2a-a152-42e2-a7e9-4dbf5d832eef tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:55.132752 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f1ddb7d8-8bcf-46af-b4f2-5abd2f6db303 req-b513fb2a-a152-42e2-a7e9-4dbf5d832eef tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 946 time: 0.0838416
Jun 01 11:13:55.227434 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f1ddb7d8-8bcf-46af-b4f2-5abd2f6db303 req-679d42e5-9053-450d-9d2f-73c6ad4d52dd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=597e6795-c293-4730-a3b5-4cd55da732ae&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0631695
Jun 01 11:13:55.247380 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-fbc40c11-0d5f-4e1e-b264-f398eb4eeaf1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:55.248907 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-fbc40c11-0d5f-4e1e-b264-f398eb4eeaf1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 946 time: 0.1152725
Jun 01 11:13:55.250411 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ccc28be7-0dea-427f-b666-10d921638b8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:55.319393 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:55.392804 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Deleting port 6c613458-8891-4e54-aa10-4a7743587916 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:13:55.393090 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:55.522651 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] For port 6c613458-8891-4e54-aa10-4a7743587916, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c613458-8891-4e54-aa10-4a7743587916,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:55.522999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:55.819624 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:55.819624 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:55.819990 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Floating IP 898b31c3-a1df-4302-b729-ff58b2760871 disassociated. External IP: 172.27.3.155, port: 6c613458-8891-4e54-aa10-4a7743587916.
Jun 01 11:13:55.820357 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Calling delete_port for 6c613458-8891-4e54-aa10-4a7743587916 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:13:55.937093 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:55.945110 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:55.997661 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event deleted for resources: {'Port': ['ID=6c613458-8891-4e54-aa10-4a7743587916,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:56.001351 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:56.339773 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Router 27b3b506-6634-49e2-b666-8f59cfd9cf96 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:13:56.387902 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:56.397252 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8ffeb703-5555-48c4-9fbf-0a28d9490e79 req-3194a12f-7f74-405b-8cd8-8ae762487cb5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e HTTP/1.1" status: 200  len: 210 time: 0.0563364
Jun 01 11:13:56.463246 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96464736-dc2e-4d79-a290-18c232d51580 req-c493af38-06f4-40eb-ac11-dc60ebea93b6 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:56.464709 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96464736-dc2e-4d79-a290-18c232d51580 req-c493af38-06f4-40eb-ac11-dc60ebea93b6 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 943 time: 0.3146210
Jun 01 11:13:56.594610 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96464736-dc2e-4d79-a290-18c232d51580 req-8ed77ec7-ede5-4eca-b3eb-e9d67cbc35d0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1212633
Jun 01 11:13:56.614211 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:13:56.624512 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] Sync routers for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:13:56.634369 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:13:56.635460 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57988db820>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:13:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:13:56.691241 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] No DVR routers for this DVR port 6c613458-8891-4e54-aa10-4a7743587916 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:13:56.694881 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:56.706060 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e4834f17-e462-4a26-af24-ae9f5f375b17 req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "DELETE /v2.0/ports/6c613458-8891-4e54-aa10-4a7743587916 HTTP/1.1" status: 204  len: 173 time: 1.4499140
Jun 01 11:13:56.826526 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:13:56.854817 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-deleted', 'tag': '6c613458-8891-4e54-aa10-4a7743587916'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:13:56.857550 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd5e2a03-c6bd-4f21-8a56-0a8920685d6e" -d '{"events": [{"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-deleted", "tag": "6c613458-8891-4e54-aa10-4a7743587916"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:13:56.902924 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:13:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19b1618e-bc89-473a-99c1-88972192ce14 x-openstack-request-id: req-19b1618e-bc89-473a-99c1-88972192ce14 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:13:56.903334 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e", "name": "network-vif-deleted", "tag": "6c613458-8891-4e54-aa10-4a7743587916", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:13:56.903655 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-19b1618e-bc89-473a-99c1-88972192ce14 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:13:56.904110 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9f8d211-aeab-4a91-9aad-0b5efb8b9e3e', 'name': 'network-vif-deleted', 'tag': '6c613458-8891-4e54-aa10-4a7743587916', 'status': 'completed', 'code': 200}
Jun 01 11:13:57.156730 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57988db820>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:13:57.164743 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] Checking router: 27b3b506-6634-49e2-b666-8f59cfd9cf96 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:13:57.175752 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:13:57.176708 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57988db820>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:13:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:13:57.380087 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:13:57.546483 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 8188fbc7-28fc-4aa3-8f48-39221c1646fb details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:13:57.554900 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 35944) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:57.622938 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-49173d14-f89f-4985-a08d-c997afada860 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:57.653846 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:13:57.656674 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-49173d14-f89f-4985-a08d-c997afada860 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:57.722423 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:13:57.722861 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 3ad75ad9-2e01-4265-9705-f59d3e60c4e7 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:13:57.754649 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-49173d14-f89f-4985-a08d-c997afada860 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:57.763939 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cfbe82b4-0afd-4724-b285-e735b7e8b704 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:57.792009 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49173d14-f89f-4985-a08d-c997afada860 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=597e6795-c293-4730-a3b5-4cd55da732ae,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:57.794865 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-49173d14-f89f-4985-a08d-c997afada860 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:57.804432 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-49173d14-f89f-4985-a08d-c997afada860 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:57.805586 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-49173d14-f89f-4985-a08d-c997afada860 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "DELETE /v2.0/security-groups/597e6795-c293-4730-a3b5-4cd55da732ae HTTP/1.1" status: 204  len: 168 time: 0.2497613
Jun 01 11:13:57.808837 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35950) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:57.830644 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.api.v2.resource [None req-069e5a7d-558b-47a9-8bc7-21cdd61de365 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] show failed (client error): The resource could not be found.
Jun 01 11:13:57.835679 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 35954) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:57.835935 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-069e5a7d-558b-47a9-8bc7-21cdd61de365 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups/597e6795-c293-4730-a3b5-4cd55da732ae HTTP/1.1" status: 404  len: 347 time: 0.0255110
Jun 01 11:13:57.836967 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:57.845109 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eef7930-744e-4e93-8958-62829459d4dc req-98b4f3c4-2158-4717-b96c-47835aa55669 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:57.846473 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1eef7930-744e-4e93-8958-62829459d4dc req-98b4f3c4-2158-4717-b96c-47835aa55669 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 943 time: 0.1277933
Jun 01 11:13:57.890310 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 8188fbc7-28fc-4aa3-8f48-39221c1646fb, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=8188fbc7-28fc-4aa3-8f48-39221c1646fb,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:57.931745 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '8188fbc7-28fc-4aa3-8f48-39221c1646fb', 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793', 'port_id': '8188fbc7-28fc-4aa3-8f48-39221c1646fb', 'mac_address': 'fa:16:3e:89:0e:9f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 682, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6ccfaae8-bb7e-4cdd-ba83-2bee1577d247', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:13:58.009077 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:58.029346 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8188fbc7-28fc-4aa3-8f48-39221c1646fb {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:13:58.050192 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 8188fbc7-28fc-4aa3-8f48-39221c1646fb, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=8188fbc7-28fc-4aa3-8f48-39221c1646fb,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:13:58.055380 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57988db820>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:13:58.064515 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:58.067156 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:58.078040 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1eef7930-744e-4e93-8958-62829459d4dc req-e6fa0333-a307-4f6a-a3e4-f6d819c13181 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1700120
Jun 01 11:13:58.108769 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b6bf250-a6cf-4a50-ae96-e0f01b75019b None None] The sync data for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi is: [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:13:58.115455 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Deleting port 65052034-264b-4147-924a-51fb4cb964c9 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:13:58.116209 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:58.154322 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=8188fbc7-28fc-4aa3-8f48-39221c1646fb,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:58.162721 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.163111 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.163453 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.163819 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.164151 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.164478 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.165257 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.165597 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.165931 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.166256 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.166584 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.166960 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:58.171510 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:58.245672 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:58.245996 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:58.365137 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd3f7825-b443-4ced-8ee4-c6b53502e6f0 None None] New status for floating IP 898b31c3-a1df-4302-b729-ff58b2760871: DOWN {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:13:58.372641 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Calling delete_port for 65052034-264b-4147-924a-51fb4cb964c9 owned by network:floatingip {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:13:58.499377 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:58.503732 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:58.517152 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.db.api [None req-cd3f7825-b443-4ced-8ee4-c6b53502e6f0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=119243) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
Jun 01 11:13:58.517530 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_db.api [None req-cd3f7825-b443-4ced-8ee4-c6b53502e6f0 None None] Performing DB retry for function neutron.api.rpc.handlers.l3_rpc.L3RpcCallback.update_floatingip_statuses {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
Jun 01 11:13:58.546840 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event deleted for resources: {'Port': ['ID=65052034-264b-4147-924a-51fb4cb964c9,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:58.549952 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:58.641233 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:58.651340 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:58.652550 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "DELETE /v2.0/floatingips/898b31c3-a1df-4302-b729-ff58b2760871 HTTP/1.1" status: 204  len: 168 time: 0.8051336
Jun 01 11:13:58.949639 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 35962) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:58.955312 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1367524518', 'description': 'tempest-description--794763912'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:58.961210 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:58.965299 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:security_group and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:58.968902 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:58.975432 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:58.984823 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.004870 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:59.008517 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:security_group_rule and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:59.011520 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:59.017197 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:59.018664 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd3f7825-b443-4ced-8ee4-c6b53502e6f0 None None] New status for floating IP 898b31c3-a1df-4302-b729-ff58b2760871: DOWN {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:13:59.088379 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.093438 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.098779 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1890f95c-b7d0-4e3f-b7d9-47939add3bb5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:59.137902 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'SecurityGroup': ['ID=62d034d5-70ed-4a77-95de-b54bea075ef8,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:59.143360 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:59.150364 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.155251 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35968) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:59.155769 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.2046587
Jun 01 11:13:59.161241 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'security_group_rule': {'security_group_id': '62d034d5-70ed-4a77-95de-b54bea075ef8', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:59.167333 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:59.172065 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:security_group_rule and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:59.175975 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:59.182207 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:59.197999 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.259248 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.263366 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.269638 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f31e1e27-4a96-4b9f-a872-7ed7468cc859 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:59.289899 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=73315415-5d70-4862-97b4-093de1c88d27,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:59.302786 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.303171 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.303880 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.304256 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.304686 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.305118 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.305834 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.306251 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.306605 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.306955 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.307302 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.307664 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:13:59.311882 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:59.313268 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.317914 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-0608b60a-7017-4d3b-8c81-304f76b1d088 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1575446
Jun 01 11:13:59.318413 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 35972) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:59.323404 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'security_group_rule': {'security_group_id': '62d034d5-70ed-4a77-95de-b54bea075ef8', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:59.330877 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:59.334950 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:security_group_rule and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:59.337919 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:59.343803 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:59.359843 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.385676 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36e13126-0b07-49cb-adf7-f1734377b841 req-3931b06f-b547-46af-a29e-583ff075bd48 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:13:59.387123 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-36e13126-0b07-49cb-adf7-f1734377b841 req-3931b06f-b547-46af-a29e-583ff075bd48 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 944 time: 0.1814616
Jun 01 11:13:59.421551 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.425719 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.427813 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-309ce8ab-1158-4004-b579-924fe417e318 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:13:59.434098 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-36e13126-0b07-49cb-adf7-f1734377b841 req-53d39273-efc8-479a-a0ce-fcb3dcd7de50 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400040
Jun 01 11:13:59.457406 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=76f42503-d537-4bcc-a269-6427d446a7e1,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:13:59.460394 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:13:59.463436 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.467753 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 35978) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:13:59.467886 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1486218
Jun 01 11:13:59.472954 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'floatingip': {'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:13:59.478624 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:13:59.482987 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Usage tracker for resource:floatingip and tenant:c004520781bb4854b87284b73cc2a8be is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:13:59.485988 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:13:59.492332 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:13:59.503115 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.636782 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.774496 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Allocated IP 172.27.3.237 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/649c7ab7-343d-4623-859e-ea2a9af5e3ac) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:13:59.921098 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.949495 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:13:59.956457 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1c358982-6cb0-44cb-9cad-6b501c355bdc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:00.019560 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:00.022346 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:00.024712 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:00.059160 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'Port': ['ID=649c7ab7-343d-4623-859e-ea2a9af5e3ac,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:00.063144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:00.148694 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:00.213081 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:00.412899 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:00.417444 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:00.421829 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:00.528728 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'Port': ['ID=649c7ab7-343d-4623-859e-ea2a9af5e3ac,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:00.533240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:00.541003 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:00.608972 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:00.610137 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.1413865
Jun 01 11:14:00.638119 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d66e60-bfc0-45c5-b6a1-83081c4a7155 req-74855bf7-c881-4ae6-a2ec-d9cd83266d62 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:00.640239 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-79d66e60-bfc0-45c5-b6a1-83081c4a7155 req-74855bf7-c881-4ae6-a2ec-d9cd83266d62 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 944 time: 0.0951164
Jun 01 11:14:00.687677 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-79d66e60-bfc0-45c5-b6a1-83081c4a7155 req-44172c39-207e-4612-b2a7-4e698ddb5d54 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414188
Jun 01 11:14:00.828546 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-a9526bc5-2236-46ef-a8ad-a81609130ce2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Synchronizing usage tracker for tenant:c004520781bb4854b87284b73cc2a8be on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:14:00.844277 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-a9526bc5-2236-46ef-a8ad-a81609130ce2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Unset dirty status for tenant:c004520781bb4854b87284b73cc2a8be on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:14:00.845420 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-a9526bc5-2236-46ef-a8ad-a81609130ce2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-securitygroup--1367524518&fields=id&tenant_id=c004520781bb4854b87284b73cc2a8be HTTP/1.1" status: 200  len: 267 time: 0.0574174
Jun 01 11:14:00.848438 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['8188fbc7-28fc-4aa3-8f48-39221c1646fb'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:14:01.009354 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-d14f054b-2325-4800-ba94-5502a7d754f2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:01.011051 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-d14f054b-2325-4800-ba94-5502a7d754f2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 816 time: 0.1542552
Jun 01 11:14:01.029243 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-e61c1cf2-83fe-4c35-8a2d-3ecf2c62de88 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/quotas/c004520781bb4854b87284b73cc2a8be HTTP/1.1" status: 200  len: 375 time: 0.0097718
Jun 01 11:14:01.113714 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-11e86d32-4699-4339-b3d0-bc26e903ed96 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Synchronizing usage tracker for tenant:c004520781bb4854b87284b73cc2a8be on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:14:01.129904 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-11e86d32-4699-4339-b3d0-bc26e903ed96 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Unset dirty status for tenant:c004520781bb4854b87284b73cc2a8be on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:14:01.131314 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-11e86d32-4699-4339-b3d0-bc26e903ed96 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0960262
Jun 01 11:14:01.277073 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-6dcb97a7-1c30-4e9c-86ca-a6d5f4a625a0 service neutron] 10.222.0.74 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1323745
Jun 01 11:14:01.548274 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-6283b16d-b36e-4c3b-9b25-b4c4fb91ee4b service neutron] 10.222.0.74 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2648880
Jun 01 11:14:01.565742 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6369d0ec-56b1-4dbe-a438-9f8976e347ee req-ae94a15a-1cfc-4463-8495-128b83bff0f0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:01.567181 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6369d0ec-56b1-4dbe-a438-9f8976e347ee req-ae94a15a-1cfc-4463-8495-128b83bff0f0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.1277111
Jun 01 11:14:01.614211 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6369d0ec-56b1-4dbe-a438-9f8976e347ee req-c06ed2f2-43a9-4772-b338-2d0a87ac2112 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412390
Jun 01 11:14:01.738479 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-87b33e22-c4c5-41e9-a759-0e07b327d652 req-d57033af-9bd3-437a-bb3a-ba13c2d5b280 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 210 time: 0.0496042
Jun 01 11:14:01.890013 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d60f3f-60ae-4030-b91d-95e47c2cd48f req-978c24d6-38ed-4cd4-87e6-85cdc220a582 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:01.891519 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b3d60f3f-60ae-4030-b91d-95e47c2cd48f req-978c24d6-38ed-4cd4-87e6-85cdc220a582 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 944 time: 0.0861893
Jun 01 11:14:01.939930 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b3d60f3f-60ae-4030-b91d-95e47c2cd48f req-6a42a99e-727b-4a89-b522-831e5c537a71 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417368
Jun 01 11:14:02.543149 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 8188fbc7-28fc-4aa3-8f48-39221c1646fb up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:02.612342 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 8188fbc7-28fc-4aa3-8f48-39221c1646fb completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:02.616792 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 8188fbc7-28fc-4aa3-8f48-39221c1646fb triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:02.617208 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:02.732766 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:02.762029 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '30b72546-8e51-4187-b117-40d55cc14dff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8188fbc7-28fc-4aa3-8f48-39221c1646fb'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:02.764800 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-89e647ca-288e-413a-89bd-8c57757df0a4" -d '{"events": [{"server_uuid": "30b72546-8e51-4187-b117-40d55cc14dff", "name": "network-vif-plugged", "status": "completed", "tag": "8188fbc7-28fc-4aa3-8f48-39221c1646fb"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:02.775564 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 8188fbc7-28fc-4aa3-8f48-39221c1646fb, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=8188fbc7-28fc-4aa3-8f48-39221c1646fb,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:02.780835 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:02.781845 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:14:02.804879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc407c53-c646-4bac-a5ac-f29940d1f9ef req-3ed9b5c0-f309-4630-b13e-135a4c1c8625 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:02.806543 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dc407c53-c646-4bac-a5ac-f29940d1f9ef req-3ed9b5c0-f309-4630-b13e-135a4c1c8625 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.0853264
Jun 01 11:14:02.811971 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:02.851206 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64af1e64-4cbd-4459-a2f9-7331877d984b x-openstack-request-id: req-64af1e64-4cbd-4459-a2f9-7331877d984b {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:02.851667 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "30b72546-8e51-4187-b117-40d55cc14dff", "name": "network-vif-plugged", "status": "completed", "tag": "8188fbc7-28fc-4aa3-8f48-39221c1646fb", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:02.852183 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-64af1e64-4cbd-4459-a2f9-7331877d984b {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:02.852777 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '30b72546-8e51-4187-b117-40d55cc14dff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8188fbc7-28fc-4aa3-8f48-39221c1646fb', 'code': 200}
Jun 01 11:14:02.864784 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 6c613458-8891-4e54-aa10-4a7743587916 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:14:02.865451 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 6c613458-8891-4e54-aa10-4a7743587916 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:14:02.889283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dc407c53-c646-4bac-a5ac-f29940d1f9ef req-9d7e5fe0-42e8-4a50-b30a-c5fd3bdb842b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0745940
Jun 01 11:14:02.894646 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=8188fbc7-28fc-4aa3-8f48-39221c1646fb,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:02.898309 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:02.962498 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a23c04c6-705a-46bd-a534-c1cc01068a4a req-724edf26-73af-4572-9a7e-2641447ef289 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 210 time: 0.0444667
Jun 01 11:14:03.302231 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-b5318b1d-f0e5-4d59-8d46-530c0b35c0a0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:03.303672 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-b5318b1d-f0e5-4d59-8d46-530c0b35c0a0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 816 time: 0.2713521
Jun 01 11:14:03.319262 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b62f2c18-cea1-43fc-a16f-1be88ac6a2cc req-81dc3c2a-ef1e-4adb-a9f8-197a52af2aff tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:03.320664 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b62f2c18-cea1-43fc-a16f-1be88ac6a2cc req-81dc3c2a-ef1e-4adb-a9f8-197a52af2aff tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 945 time: 0.2611923
Jun 01 11:14:03.322525 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2fe880-192c-4740-a872-797d1ba1f886 req-5442af92-a16f-4cfe-9cea-20f443abe564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:03.323888 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-be2fe880-192c-4740-a872-797d1ba1f886 req-5442af92-a16f-4cfe-9cea-20f443abe564 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 1098 time: 0.2904229
Jun 01 11:14:03.426160 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b62f2c18-cea1-43fc-a16f-1be88ac6a2cc req-f04c3006-156c-4fc3-9096-3ef5e544be63 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0889323
Jun 01 11:14:03.429882 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-390e0240-3003-4ee8-8203-573eaa10e4ef tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c004520781bb4854b87284b73cc2a8be HTTP/1.1" status: 200  len: 380 time: 0.1051500
Jun 01 11:14:03.433285 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-be2fe880-192c-4740-a872-797d1ba1f886 req-e850dedd-d9c5-46ed-8a26-147fc198badc service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0936561
Jun 01 11:14:03.504067 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'port': {'device_id': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'admin_state_up': True, 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'security_groups': ['62d034d5-70ed-4a77-95de-b54bea075ef8']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:03.648419 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:03.660629 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:03.670943 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Made reservation on behalf of c004520781bb4854b87284b73cc2a8be for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:14:03.674510 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:03.838682 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Allocated IP 172.20.0.11 (ce8e721a-c529-4460-882f-9261a0c7ceed/79a8ddfd-a675-47e5-9921-33f71f58d781/e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:04.154942 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1d110524-4db5-4913-9893-9060b47729f9 req-77434b3b-251a-4aa5-9433-79f35342efb6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 210 time: 0.0692978
Jun 01 11:14:04.183397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:04.209622 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-aa901a0d-9fbb-485b-ac26-5e9724607be1 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:04.211037 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-aa901a0d-9fbb-485b-ac26-5e9724607be1 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.3163147
Jun 01 11:14:04.214647 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Transition to ACTIVE for port object e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c will not be triggered until provisioned by entity DHCP. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:04.226634 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a58c78ef-2c52-4f73-937f-fdd7e3c24551 req-5e446d93-2e68-4bd5-bacc-6c0f730ea443 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:04.228043 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a58c78ef-2c52-4f73-937f-fdd7e3c24551 req-5e446d93-2e68-4bd5-bacc-6c0f730ea443 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.2165372
Jun 01 11:14:04.456399 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a58c78ef-2c52-4f73-937f-fdd7e3c24551 req-068b022d-e078-4d1e-a845-3d6cfa0527af tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1934838
Jun 01 11:14:04.475428 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:04.490928 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2793e547-dfa1-4860-8513-9ae5113c1e5e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:04.605898 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Network ce8e721a-c529-4460-882f-9261a0c7ceed is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:04.611846 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:04.619288 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:04.654770 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:04.667559 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:04.700965 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Deleting port c4a9498c-cfd5-4c11-ba25-e4985d580263 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:14:04.701356 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:04.725699 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:04.726327 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:04.835358 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.3353143
Jun 01 11:14:04.844480 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-4f01d96b-4052-40e0-85d6-968d77f066d9 None None] Provisioning for port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:04.845286 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc1d62d-213b-4a8d-98ff-a272e08d0deb req-d072b706-c623-48d4-a2ad-9131b40c83de tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:04.847027 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9cc1d62d-213b-4a8d-98ff-a272e08d0deb req-d072b706-c623-48d4-a2ad-9131b40c83de tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 945 time: 0.3040969
Jun 01 11:14:04.850339 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-4f01d96b-4052-40e0-85d6-968d77f066d9 None None] Provisioning complete for port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:04.850892 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-4f01d96b-4052-40e0-85d6-968d77f066d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:04.851527 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Request body: {'port': {'device_id': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:04.909448 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-4f01d96b-4052-40e0-85d6-968d77f066d9 None None] Port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:14:04.972561 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] For port c4a9498c-cfd5-4c11-ba25-e4985d580263, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c4a9498c-cfd5-4c11-ba25-e4985d580263,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:04.972830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:05.015952 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9cc1d62d-213b-4a8d-98ff-a272e08d0deb req-2790b119-c710-4849-9124-9562fb1ddd5f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1248400
Jun 01 11:14:05.122830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:05.513240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:05.514391 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:05.514548 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Floating IP 78d6aaef-834f-4604-a6cb-fec4c348d4e0 disassociated. External IP: 172.27.3.86, port: c4a9498c-cfd5-4c11-ba25-e4985d580263.
Jun 01 11:14:05.514756 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Calling delete_port for c4a9498c-cfd5-4c11-ba25-e4985d580263 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:14:05.656818 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8a3dac9-a732-4581-a2e9-3dca0cc190c8 req-1d7a44bb-69a2-4a65-88d2-2c949cade821 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:05.657510 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c8a3dac9-a732-4581-a2e9-3dca0cc190c8 req-1d7a44bb-69a2-4a65-88d2-2c949cade821 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Synchronizing usage tracker for tenant:c004520781bb4854b87284b73cc2a8be on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:14:05.720640 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-c8a3dac9-a732-4581-a2e9-3dca0cc190c8 req-1d7a44bb-69a2-4a65-88d2-2c949cade821 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Unset dirty status for tenant:c004520781bb4854b87284b73cc2a8be on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:14:05.722333 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c8a3dac9-a732-4581-a2e9-3dca0cc190c8 req-1d7a44bb-69a2-4a65-88d2-2c949cade821 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 932 time: 0.4511824
Jun 01 11:14:05.804289 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf5819a-f700-4ce9-9047-df40c282a45c req-c8f6bd2f-c590-493b-a0ab-dc825aba30d6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:05.805642 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2cf5819a-f700-4ce9-9047-df40c282a45c req-c8f6bd2f-c590-493b-a0ab-dc825aba30d6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 945 time: 0.2384729
Jun 01 11:14:05.902746 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c8a3dac9-a732-4581-a2e9-3dca0cc190c8 req-2a7a6355-dbcf-4ed1-b901-64135967954c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1708863
Jun 01 11:14:05.931755 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:14:05.956204 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:05.990981 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2cf5819a-f700-4ce9-9047-df40c282a45c req-a6487217-65aa-4cab-87c4-bc3b72c04d35 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=cec527c5-3f99-4b4b-9bff-bd673a842279&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1500957
Jun 01 11:14:05.992038 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Transition to ACTIVE for port object e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:05.992794 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:05.999794 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:06.139301 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:06.182742 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event deleted for resources: {'Port': ['ID=c4a9498c-cfd5-4c11-ba25-e4985d580263,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:06.189397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:06.194671 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-52cca3da-9267-4f8c-90ef-f35e6e0a506c tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.017s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:06.446439 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:06.456279 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:06.551268 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c4a9498c-cfd5-4c11-ba25-e4985d580263 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:14:06.596135 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: c4a9498c-cfd5-4c11-ba25-e4985d580263 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:14:06.596942 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c4a9498c-cfd5-4c11-ba25-e4985d580263 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:14:06.624152 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-526a1d70-703c-4326-a659-f6994b942b40 req-c42fd1a5-3c52-4636-b6ae-ce6943a331f2 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:06.625649 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-526a1d70-703c-4326-a659-f6994b942b40 req-c42fd1a5-3c52-4636-b6ae-ce6943a331f2 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 945 time: 0.4971118
Jun 01 11:14:06.656144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Attempting to bind port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:14:06.656481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Attempting to bind port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:14:06.656810 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Attempting to bind port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c on network ce8e721a-c529-4460-882f-9261a0c7ceed {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:06.672809 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Router abf03e4b-fdd0-44b3-86be-277da7892b4a has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:14:06.683726 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c on network ce8e721a-c529-4460-882f-9261a0c7ceed not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:14:06.684036 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Attempting to bind port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c on network ce8e721a-c529-4460-882f-9261a0c7ceed {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:06.697230 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 13, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:14:06.697563 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Checking segment: {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:06.697950 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Bound using segment: {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:14:06.698379 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Bound port: e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '218ec5cc-bc49-4575-bae0-d28b11abe976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:14:06.698717 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:06.718457 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-526a1d70-703c-4326-a659-f6994b942b40 req-bd17dc09-2a3a-4938-a977-baf14beb5275 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0844932
Jun 01 11:14:06.947574 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:14:06.955056 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:14:06.961372 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:06.968181 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:07.016858 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:14:07.033590 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] Sync routers for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:14:07.045277 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:07.046651 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798594820>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:13:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:07.190092 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:07.190806 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:07.192329 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] 10.222.0.79 "PUT /v2.0/ports/e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c HTTP/1.1" status: 200  len: 1094 time: 2.3446658
Jun 01 11:14:07.198463 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] No DVR routers for this DVR port c4a9498c-cfd5-4c11-ba25-e4985d580263 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:14:07.212869 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:07.215931 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'}, {'server_uuid': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'name': 'network-vif-deleted', 'tag': 'c4a9498c-cfd5-4c11-ba25-e4985d580263'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:07.218890 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-933ccd3f-6f9c-49bf-a216-8448f8b47141" -d '{"events": [{"name": "network-changed", "server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c"}, {"server_uuid": "4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2", "name": "network-vif-deleted", "tag": "c4a9498c-cfd5-4c11-ba25-e4985d580263"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:07.300470 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-92c3b008-598f-490d-bee1-35f7ca03ad5f req-5db8779f-9ca5-4923-b7b6-7ad3220438ce tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Synchronizing usage tracker for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:14:07.310237 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4a9b4187-cb4f-44df-8835-960c20790f29 req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "DELETE /v2.0/ports/c4a9498c-cfd5-4c11-ba25-e4985d580263 HTTP/1.1" status: 204  len: 173 time: 3.0802932
Jun 01 11:14:07.321437 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:07.324847 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.357s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:07.341374 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-92c3b008-598f-490d-bee1-35f7ca03ad5f req-5db8779f-9ca5-4923-b7b6-7ad3220438ce tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Unset dirty status for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:14:07.343031 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-92c3b008-598f-490d-bee1-35f7ca03ad5f req-5db8779f-9ca5-4923-b7b6-7ad3220438ce tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 210 time: 0.1165931
Jun 01 11:14:07.346097 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:07.372447 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e1a015-9070-42f3-b1fd-02f01b0d44c3 req-d1b2e9d3-cb1a-4315-8e86-ffbff73a1bd3 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:07.374801 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-31e1a015-9070-42f3-b1fd-02f01b0d44c3 req-d1b2e9d3-cb1a-4315-8e86-ffbff73a1bd3 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.3204677
Jun 01 11:14:07.412636 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05458b5e-0016-4f0c-99c0-342515e23f80 x-openstack-request-id: req-05458b5e-0016-4f0c-99c0-342515e23f80 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:07.412957 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c", "status": "completed", "code": 200}, {"server_uuid": "4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2", "name": "network-vif-deleted", "tag": "c4a9498c-cfd5-4c11-ba25-e4985d580263", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:07.413233 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-05458b5e-0016-4f0c-99c0-342515e23f80 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:07.413645 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'status': 'completed', 'code': 200}
Jun 01 11:14:07.413949 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2', 'name': 'network-vif-deleted', 'tag': 'c4a9498c-cfd5-4c11-ba25-e4985d580263', 'status': 'completed', 'code': 200}
Jun 01 11:14:07.423998 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-31e1a015-9070-42f3-b1fd-02f01b0d44c3 req-e5b84267-c910-47a7-bf69-a282f7cb69a0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433924
Jun 01 11:14:07.696605 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798594820>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:07.700558 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] Checking router: abf03e4b-fdd0-44b3-86be-277da7892b4a for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:14:07.709019 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:07.709621 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798594820>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:13:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:07.885714 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:08.196392 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798594820>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:08.200287 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf0101f2-fac9-4962-8ec3-b0810711e711 None None] The sync data for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi is: [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:14:08.412625 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11ca9c66-7a18-4c86-bf25-80ebcfbfb7d4 None None] New status for floating IP 78d6aaef-834f-4604-a6cb-fec4c348d4e0: DOWN {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:14:08.498245 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5fe60da6-82a0-43fa-98f7-c8bfe06757fb req-694d516f-f611-457f-a57e-b2771ec58e35 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 210 time: 0.0427225
Jun 01 11:14:08.618302 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff2e044-db8a-4b4b-a77f-46d5b72e47cf req-c21e4a62-351a-41bf-9be6-5a3c71621075 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:08.619859 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ff2e044-db8a-4b4b-a77f-46d5b72e47cf req-c21e4a62-351a-41bf-9be6-5a3c71621075 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0838122
Jun 01 11:14:08.668972 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2ff2e044-db8a-4b4b-a77f-46d5b72e47cf req-773e50e5-18e5-4508-879b-8b857e2bf797 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0428419
Jun 01 11:14:09.644759 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-921af18d-a009-452e-afa2-cf767b38e627 req-2d955b50-a8d1-4206-aad1-a5c326b835e6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=4ad6b3f7-f076-40a2-99a7-3b91eca4b1b2 HTTP/1.1" status: 200  len: 210 time: 0.0422904
Jun 01 11:14:09.910312 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53d2b9d5-fef8-478e-a955-ab048b79f4ce req-b90974ab-c08a-46b5-a856-4e2709591501 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:09.911915 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-53d2b9d5-fef8-478e-a955-ab048b79f4ce req-b90974ab-c08a-46b5-a856-4e2709591501 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0844352
Jun 01 11:14:10.111027 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-53d2b9d5-fef8-478e-a955-ab048b79f4ce req-ad598ba2-1917-47d0-8838-96bb05d16bc0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1931968
Jun 01 11:14:10.132234 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933ccd3f-6f9c-49bf-a216-8448f8b47141 req-f7e3b529-5a35-4694-b30d-5b6abe084cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:10.133682 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-933ccd3f-6f9c-49bf-a216-8448f8b47141 req-f7e3b529-5a35-4694-b30d-5b6abe084cb0 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 1097 time: 0.0924375
Jun 01 11:14:10.279973 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933ccd3f-6f9c-49bf-a216-8448f8b47141 req-fba1e29c-c950-4617-86cc-f7335a802795 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:10.281338 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-933ccd3f-6f9c-49bf-a216-8448f8b47141 req-fba1e29c-c950-4617-86cc-f7335a802795 service neutron] 10.222.0.79 "GET /v2.0/networks?tenant_id=c004520781bb4854b87284b73cc2a8be&shared=False HTTP/1.1" status: 200  len: 917 time: 0.1349115
Jun 01 11:14:10.424099 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933ccd3f-6f9c-49bf-a216-8448f8b47141 req-79da3b53-5eea-446e-939f-7eacb862494e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:10.425559 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-933ccd3f-6f9c-49bf-a216-8448f8b47141 req-79da3b53-5eea-446e-939f-7eacb862494e service neutron] 10.222.0.79 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1337311
Jun 01 11:14:10.561614 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-8686f4b1-5631-4463-851f-a84da4ddbf69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:10.563072 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-8686f4b1-5631-4463-851f-a84da4ddbf69 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 1097 time: 0.0811732
Jun 01 11:14:10.642432 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-e8d31ea1-a578-40de-92b1-6f8d2fa96e32 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c HTTP/1.1" status: 200  len: 217 time: 0.0688770
Jun 01 11:14:10.738954 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-360a400a-626e-413d-89a9-ad39cb6d1838 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:10.740744 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-360a400a-626e-413d-89a9-ad39cb6d1838 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.0865781
Jun 01 11:14:10.777763 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36126) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:10.841101 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-c7400ca1-5fc2-4cbe-9f29-36303b63345a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:10.843210 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-c7400ca1-5fc2-4cbe-9f29-36303b63345a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0820456
Jun 01 11:14:10.864921 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fe110e80-e033-4c59-b79a-96747513202c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:10.894381 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fe110e80-e033-4c59-b79a-96747513202c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:10.953785 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fe110e80-e033-4c59-b79a-96747513202c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:10.971868 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-91997ca1-be07-4a1d-b5c0-f1cb16baaa41 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:10.993367 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fe110e80-e033-4c59-b79a-96747513202c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:10.994673 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-fe110e80-e033-4c59-b79a-96747513202c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "DELETE /v2.0/security-groups/cec527c5-3f99-4b4b-9bff-bd673a842279 HTTP/1.1" status: 204  len: 168 time: 0.2149923
Jun 01 11:14:10.995827 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe110e80-e033-4c59-b79a-96747513202c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cec527c5-3f99-4b4b-9bff-bd673a842279,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:11.002617 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36134) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:11.021785 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fe110e80-e033-4c59-b79a-96747513202c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:11.026656 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-5856b810-9731-4e6b-926b-039e493ee9e0 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1757622
Jun 01 11:14:11.167322 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.api.v2.resource [None req-f2bdeca1-1ce9-42fd-93e7-d06542422f72 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] show failed (client error): The resource could not be found.
Jun 01 11:14:11.171892 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f2bdeca1-1ce9-42fd-93e7-d06542422f72 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups/cec527c5-3f99-4b4b-9bff-bd673a842279 HTTP/1.1" status: 404  len: 347 time: 0.1665690
Jun 01 11:14:11.172038 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36144) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:11.391326 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1ee1bc28-29f0-4662-8e13-91262cb6925e req-3d79570b-f1c8-488e-8969-e343f4954b1f service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3581667
Jun 01 11:14:11.516058 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f30b915-27ca-4a0b-9e08-13ae9b497760 req-044b1e28-522b-4303-8fdc-999ce89bd548 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:11.517538 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1f30b915-27ca-4a0b-9e08-13ae9b497760 req-044b1e28-522b-4303-8fdc-999ce89bd548 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.2743568
Jun 01 11:14:11.522103 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Deleting port bb53334f-4b00-4b6b-98b3-45d16f841218 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:14:11.522439 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:11.643495 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1f30b915-27ca-4a0b-9e08-13ae9b497760 req-586a6643-e81b-487d-8e27-51cffcf75a3c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1062095
Jun 01 11:14:11.679351 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:11.679708 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:11.879918 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Calling delete_port for bb53334f-4b00-4b6b-98b3-45d16f841218 owned by network:floatingip {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:14:11.993153 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:11.997589 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:12.042326 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event deleted for resources: {'Port': ['ID=bb53334f-4b00-4b6b-98b3-45d16f841218,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:12.068727 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:12.135476 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.155491 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.156756 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "DELETE /v2.0/floatingips/78d6aaef-834f-4604-a6cb-fec4c348d4e0 HTTP/1.1" status: 204  len: 168 time: 0.9839499
Jun 01 11:14:12.463874 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36158) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:12.469815 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1168150396', 'description': 'tempest-description--698106008'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:12.475613 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:12.479752 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:security_group and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:12.482589 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:12.489023 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:12.498996 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.520164 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:12.524054 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:security_group_rule and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:12.526873 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:12.533559 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:12.603262 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.607239 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.612286 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-26dba08d-94f0-463f-a21f-1f0d2e22e69d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:12.653324 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:12.656032 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.659883 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.1922915
Jun 01 11:14:12.659883 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:12.660233 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36166) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:12.665527 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'security_group_rule': {'security_group_id': 'ed060348-6e4d-4c2d-9b6a-e9000cba2c4a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:12.671832 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:12.675887 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:security_group_rule and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:12.679172 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:12.687493 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:12.710424 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.831045 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.836209 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.846934 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:12.871737 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7305b567-1fd3-42e6-84c0-28b6129a1140,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:12.875322 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:12.878700 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:12.879866 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.2186577
Jun 01 11:14:12.882505 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36174) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:12.893349 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2478783-8960-43e8-9838-163cac3b9333 req-d13ea4f2-351d-45c7-aaa4-45839b9bd47e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:12.894784 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b2478783-8960-43e8-9838-163cac3b9333 req-d13ea4f2-351d-45c7-aaa4-45839b9bd47e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.1349359
Jun 01 11:14:12.897809 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'security_group_rule': {'security_group_id': 'ed060348-6e4d-4c2d-9b6a-e9000cba2c4a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:12.915791 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:12.923576 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:security_group_rule and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:12.928163 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:12.944145 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:12.966243 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b2478783-8960-43e8-9838-163cac3b9333 req-82f1145a-3d2f-402f-86a9-edb498945046 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0641818
Jun 01 11:14:12.977781 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:13.044203 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:13.049967 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:13.052036 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4b100052-df28-4df2-89a9-1e93b963f46e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:13.074605 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8cb7f919-57a8-4273-ad0c-5bb857cac75b,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:13.078924 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:13.083718 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:13.084955 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-1810de6a-1fe1-499e-8d60-dc44ada6a009 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2009587
Jun 01 11:14:13.088156 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36178) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:13.093467 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'floatingip': {'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:13.099956 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:13.103650 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Usage tracker for resource:floatingip and tenant:22a029b4c9f84f4191259891ac3af6c3 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:13.106419 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:13.113194 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:13.122056 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:13.260892 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:13.399696 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Allocated IP 172.27.3.209 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/e6a6d71a-700c-438c-aef2-425209572d36) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:13.543364 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:13.571381 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:13.574840 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-789b7d22-293f-4d99-a309-cd6ba5a7f4c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:13.634558 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:13.637741 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:13.641450 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:13.682035 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'Port': ['ID=e6a6d71a-700c-438c-aef2-425209572d36,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:13.689327 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:13.728399 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:13.785867 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:14.089960 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:14.095864 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:14.099757 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:14.170910 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa33dc2-7f7c-4090-878b-ec0cb55e3fb3 req-69be5af4-ee68-4512-aa5a-307c1aceb574 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:14.172478 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5aa33dc2-7f7c-4090-878b-ec0cb55e3fb3 req-69be5af4-ee68-4512-aa5a-307c1aceb574 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0823593
Jun 01 11:14:14.208507 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'Port': ['ID=e6a6d71a-700c-438c-aef2-425209572d36,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:14.212355 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:14.218962 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:14.224688 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5aa33dc2-7f7c-4090-878b-ec0cb55e3fb3 req-b01c9872-d2cc-4357-b3a1-78712feb21c2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452390
Jun 01 11:14:14.242649 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:14.253047 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.1550298
Jun 01 11:14:14.412301 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c688ab9b-79a6-48eb-954c-c7f737ee17a3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Synchronizing usage tracker for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:14:14.427534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c688ab9b-79a6-48eb-954c-c7f737ee17a3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Unset dirty status for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:14:14.428818 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c688ab9b-79a6-48eb-954c-c7f737ee17a3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-securitygroup--1168150396&fields=id&tenant_id=22a029b4c9f84f4191259891ac3af6c3 HTTP/1.1" status: 200  len: 267 time: 0.0594394
Jun 01 11:14:14.577270 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-526064ef-15b6-4ee4-b3ca-93c2982932bd tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:14.578605 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-526064ef-15b6-4ee4-b3ca-93c2982932bd tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 810 time: 0.1434040
Jun 01 11:14:14.592661 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-6aa64f42-41a2-4dfb-830c-cf160070b7b4 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/quotas/22a029b4c9f84f4191259891ac3af6c3 HTTP/1.1" status: 200  len: 375 time: 0.0087199
Jun 01 11:14:14.674487 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-93d26b3c-3d1b-47a0-9a35-2d65f9de0fc8 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Synchronizing usage tracker for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:14:14.691955 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-93d26b3c-3d1b-47a0-9a35-2d65f9de0fc8 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Unset dirty status for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:14:14.693251 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-93d26b3c-3d1b-47a0-9a35-2d65f9de0fc8 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0959394
Jun 01 11:14:14.870061 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-968ac9b0-d2e7-4526-b78a-51b800ffe333 service neutron] 10.222.0.74 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1649694
Jun 01 11:14:15.004053 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-fcd1b1d3-3408-491f-b611-27a898fbc557 service neutron] 10.222.0.74 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1281748
Jun 01 11:14:15.186466 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0c50eeec-9f58-42b8-91f9-ceff3862b427 req-f5c37fb4-3f7d-43ca-bc4c-8752cfc83876 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 210 time: 0.0445042
Jun 01 11:14:15.470032 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a576cd8e-8da9-41a2-a87b-ab4ae5a3d83a req-01826569-6790-4630-a015-862837f65553 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:15.471991 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a576cd8e-8da9-41a2-a87b-ab4ae5a3d83a req-01826569-6790-4630-a015-862837f65553 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0941586
Jun 01 11:14:15.521638 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a576cd8e-8da9-41a2-a87b-ab4ae5a3d83a req-544d49fd-b93e-4931-a746-327fe1b3d087 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435703
Jun 01 11:14:15.990474 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:14:16.124015 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:16.137364 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'port_id': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'mac_address': 'fa:16:3e:dc:95:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:14:16.193031 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:16.210108 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:14:16.232870 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:16.237533 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:16.239411 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:16.314027 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:16.317539 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:16.363372 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b478c207-67c5-4eb4-b425-76d94e16030e req-985890cc-d786-43a3-b979-c0e5a562286b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 210 time: 0.0514848
Jun 01 11:14:16.424113 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-bd2fe5b5-c517-4358-99f2-00b93d7dc9c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:16.425709 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-bd2fe5b5-c517-4358-99f2-00b93d7dc9c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 810 time: 0.2106726
Jun 01 11:14:16.530758 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:14:16.565067 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-f080e2f4-7b8b-4489-8918-91d9f5985ff9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=22a029b4c9f84f4191259891ac3af6c3 HTTP/1.1" status: 200  len: 380 time: 0.1283190
Jun 01 11:14:16.579964 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'port': {'device_id': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'admin_state_up': True, 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'security_groups': ['ed060348-6e4d-4c2d-9b6a-e9000cba2c4a']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:16.644282 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:16.781578 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:16.794752 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:16.803575 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a767b00-24e2-4e50-9bc4-8a307c564c14 req-c2916d30-6765-4c0c-9c82-1e3ed16a59bd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:16.805065 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a767b00-24e2-4e50-9bc4-8a307c564c14 req-c2916d30-6765-4c0c-9c82-1e3ed16a59bd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 945 time: 0.1438758
Jun 01 11:14:16.826528 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Made reservation on behalf of 22a029b4c9f84f4191259891ac3af6c3 for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:14:16.829719 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:16.905006 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a767b00-24e2-4e50-9bc4-8a307c564c14 req-71a9f639-060e-41ab-9358-3101eb147754 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0932629
Jun 01 11:14:17.011664 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Allocated IP 172.20.0.11 (418faffe-faca-4025-ab0f-56771435263e/08c4a15d-0d06-4d4b-909f-10ac28c5c16c/63851119-2409-4ad5-a740-0157c795436f) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:17.196468 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:17.211410 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Transition to ACTIVE for port object 63851119-2409-4ad5-a740-0157c795436f will not be triggered until provisioned by entity DHCP. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:17.234624 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:17.240910 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:17.301281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Network 418faffe-faca-4025-ab0f-56771435263e is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:17.304363 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:17.306871 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:17.361262 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event updated for resources: {'Port': ['ID=63851119-2409-4ad5-a740-0157c795436f,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:17.364128 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:17.385006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:17.385885 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:17.413763 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8382597
Jun 01 11:14:17.425709 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Request body: {'port': {'device_id': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:17.532677 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-bb02159e-97b8-4abb-a6f7-24f5c05b6eeb None None] Provisioning for port 63851119-2409-4ad5-a740-0157c795436f completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:17.537447 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-bb02159e-97b8-4abb-a6f7-24f5c05b6eeb None None] Provisioning complete for port 63851119-2409-4ad5-a740-0157c795436f triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:17.537829 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-bb02159e-97b8-4abb-a6f7-24f5c05b6eeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:17.588196 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:17.591067 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-bb02159e-97b8-4abb-a6f7-24f5c05b6eeb None None] Port 63851119-2409-4ad5-a740-0157c795436f cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:14:17.666976 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb090291-6031-49f7-9633-f49ae2ca4c6e req-f25c4e34-0d02-42e1-b8db-80f0b762302c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:17.667647 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-eb090291-6031-49f7-9633-f49ae2ca4c6e req-f25c4e34-0d02-42e1-b8db-80f0b762302c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Synchronizing usage tracker for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:14:17.732511 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-eb090291-6031-49f7-9633-f49ae2ca4c6e req-f25c4e34-0d02-42e1-b8db-80f0b762302c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Unset dirty status for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:14:17.733732 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eb090291-6031-49f7-9633-f49ae2ca4c6e req-f25c4e34-0d02-42e1-b8db-80f0b762302c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 932 time: 0.2560008
Jun 01 11:14:17.819794 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eb090291-6031-49f7-9633-f49ae2ca4c6e req-1df9a75a-8178-4f5b-9383-3f32959a26e6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0795481
Jun 01 11:14:17.999852 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 63851119-2409-4ad5-a740-0157c795436f {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:14:18.006781 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:18.008677 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:18.064081 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Transition to ACTIVE for port object 63851119-2409-4ad5-a740-0157c795436f will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:18.071252 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:18.078134 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3a2b54be-8d09-47ee-9a91-faf45c9dce4f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:18.089100 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:18.094213 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:18.094814 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:18.221057 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Pushing event updated for resources: {'Port': ['ID=63851119-2409-4ad5-a740-0157c795436f,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:18.225793 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:18.231183 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:18.261834 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:18.264161 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9cf01353-bf3e-4ded-8353-552693a80bf3" -d '{"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-plugged", "status": "completed", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:18.272680 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:18.281263 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:18.291881 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:18.376170 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5a6bd0d-c0a4-4f09-a01c-7cf7d3c85e8e x-openstack-request-id: req-b5a6bd0d-c0a4-4f09-a01c-7cf7d3c85e8e {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:18.376546 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-plugged", "status": "completed", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:18.376868 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-b5a6bd0d-c0a4-4f09-a01c-7cf7d3c85e8e {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:18.377319 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'code': 200}
Jun 01 11:14:18.431113 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:18.434748 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:18.469217 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077ee85a-3955-4fd6-a9b2-b12201171a58 req-77163be5-cd62-431d-b155-6af0614d94cd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:18.471250 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-077ee85a-3955-4fd6-a9b2-b12201171a58 req-77163be5-cd62-431d-b155-6af0614d94cd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 945 time: 0.4478829
Jun 01 11:14:18.558706 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Attempting to bind port 63851119-2409-4ad5-a740-0157c795436f on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:14:18.558946 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Attempting to bind port 63851119-2409-4ad5-a740-0157c795436f by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:14:18.559254 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Attempting to bind port 63851119-2409-4ad5-a740-0157c795436f on network 418faffe-faca-4025-ab0f-56771435263e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:18.579962 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-077ee85a-3955-4fd6-a9b2-b12201171a58 req-4800cde9-6d5a-4eb6-8526-5fe0fd9a604f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1014857
Jun 01 11:14:18.581327 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Port 63851119-2409-4ad5-a740-0157c795436f on network 418faffe-faca-4025-ab0f-56771435263e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:14:18.581649 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Attempting to bind port 63851119-2409-4ad5-a740-0157c795436f on network 418faffe-faca-4025-ab0f-56771435263e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:18.594735 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 14, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:14:18.595062 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Checking segment: {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:18.595450 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Bound using segment: {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:14:18.595907 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Bound port: 63851119-2409-4ad5-a740-0157c795436f, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f42fc69f-20da-4605-91d9-46f05e1a6b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '418faffe-faca-4025-ab0f-56771435263e'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:14:18.596325 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:18.683408 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf52c3b9-e4e6-4695-a2d6-c66abbeadf5e req-160115fc-04da-4f43-8f67-db06bac016bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:18.684904 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bf52c3b9-e4e6-4695-a2d6-c66abbeadf5e req-160115fc-04da-4f43-8f67-db06bac016bc service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 1099 time: 0.1720519
Jun 01 11:14:18.715475 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] For port 63851119-2409-4ad5-a740-0157c795436f, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:14:18.734129 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] For port 63851119-2409-4ad5-a740-0157c795436f, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=63851119-2409-4ad5-a740-0157c795436f,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:14:18.737844 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bf52c3b9-e4e6-4695-a2d6-c66abbeadf5e req-0f3643ac-d44c-4aa5-9ff8-8083695b5052 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0448883
Jun 01 11:14:18.739268 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:18.742711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0e2005d9-7b52-4724-b016-bf6919b6835e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:18.802152 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:18.802772 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:18.804141 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] 10.222.0.79 "PUT /v2.0/ports/63851119-2409-4ad5-a740-0157c795436f HTTP/1.1" status: 200  len: 1094 time: 1.3828847
Jun 01 11:14:18.804632 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'tag': '63851119-2409-4ad5-a740-0157c795436f'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:18.806915 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1" -d '{"events": [{"name": "network-changed", "server_uuid": "98a71b50-c504-4fff-86f4-d4d54cee7e31", "tag": "63851119-2409-4ad5-a740-0157c795436f"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:18.823934 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Pushing event updated for resources: {'Port': ['ID=63851119-2409-4ad5-a740-0157c795436f,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:18.827035 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:18.983419 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-746fa796-2010-4fb7-8f8d-c827d282af67 x-openstack-request-id: req-746fa796-2010-4fb7-8f8d-c827d282af67 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:18.983779 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "98a71b50-c504-4fff-86f4-d4d54cee7e31", "tag": "63851119-2409-4ad5-a740-0157c795436f", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:18.984069 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-746fa796-2010-4fb7-8f8d-c827d282af67 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:18.984498 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'tag': '63851119-2409-4ad5-a740-0157c795436f', 'status': 'completed', 'code': 200}
Jun 01 11:14:19.079311 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-08f72f2f-0ead-4753-b7f2-be182098f6c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:19.080473 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-08f72f2f-0ead-4753-b7f2-be182098f6c7 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 1097 time: 0.1705484
Jun 01 11:14:19.096727 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b7550be-7c73-464e-931e-a0119d27590b req-5e43bef7-ef1b-4715-9d6f-557d87aee753 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:19.098150 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6b7550be-7c73-464e-931e-a0119d27590b req-5e43bef7-ef1b-4715-9d6f-557d87aee753 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 944 time: 0.1185527
Jun 01 11:14:19.171999 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-ea0d622b-f07a-43be-894b-8de848e2c538 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=63851119-2409-4ad5-a740-0157c795436f HTTP/1.1" status: 200  len: 217 time: 0.0728726
Jun 01 11:14:19.277811 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6b7550be-7c73-464e-931e-a0119d27590b req-c1e18588-9f99-4aac-8952-5b84cb93ab66 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1212394
Jun 01 11:14:19.284750 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-793b9ffb-4f54-4a92-b4ea-b870412f10d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:19.286167 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-793b9ffb-4f54-4a92-b4ea-b870412f10d7 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=08c4a15d-0d06-4d4b-909f-10ac28c5c16c HTTP/1.1" status: 200  len: 849 time: 0.0970383
Jun 01 11:14:19.380219 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-b72c3ecd-bb23-4626-86fd-e437fed172bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:19.381755 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-b72c3ecd-bb23-4626-86fd-e437fed172bb service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=418faffe-faca-4025-ab0f-56771435263e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0880916
Jun 01 11:14:19.518220 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-60be48d3-4714-41ba-8e66-2f684a19d88b service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1271808
Jun 01 11:14:19.680399 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-810e72a2-86f6-4c03-8eb2-0f7859bdd38e req-bfa044fe-2663-4d87-82c1-5b66dc873926 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1530879
Jun 01 11:14:19.870045 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a96c36-0386-49a2-9bee-485d3bb560a5 req-97883b03-b85a-4e2e-b4f0-d5adc3d2217f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:19.871699 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f0a96c36-0386-49a2-9bee-485d3bb560a5 req-97883b03-b85a-4e2e-b4f0-d5adc3d2217f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.1451774
Jun 01 11:14:19.878247 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-26be9bd5-93f2-49eb-93a6-add6b9fc4d11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:19.879675 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-26be9bd5-93f2-49eb-93a6-add6b9fc4d11 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 1097 time: 0.1097746
Jun 01 11:14:19.947552 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f0a96c36-0386-49a2-9bee-485d3bb560a5 req-67962d57-04ad-4f3f-80b2-342dfb59105e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0669444
Jun 01 11:14:20.050432 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-7538e2b5-eb6b-48dc-8093-1cd633e1f9e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:20.051879 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-7538e2b5-eb6b-48dc-8093-1cd633e1f9e9 service neutron] 10.222.0.79 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 911 time: 0.1376202
Jun 01 11:14:20.132921 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-3ba8680e-c2b5-4ec5-9b79-a7fcc79fb1c5 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=63851119-2409-4ad5-a740-0157c795436f HTTP/1.1" status: 200  len: 217 time: 0.0597498
Jun 01 11:14:20.199605 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-87b9fd02-2551-42c1-8ecd-5b496f61ae3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:20.201025 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-87b9fd02-2551-42c1-8ecd-5b496f61ae3a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=08c4a15d-0d06-4d4b-909f-10ac28c5c16c HTTP/1.1" status: 200  len: 849 time: 0.0604939
Jun 01 11:14:20.288804 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-18e7e152-3526-4a74-91ef-d6e84d026d0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:20.290237 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-18e7e152-3526-4a74-91ef-d6e84d026d0c service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=418faffe-faca-4025-ab0f-56771435263e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0737209
Jun 01 11:14:20.572462 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-202eca8d-195d-4e46-bde6-ac2a0d3df33d service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2731240
Jun 01 11:14:20.590347 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4d4772d-6d1f-461f-a1c9-565f415b51c7 req-2e162fb5-5726-433b-b4e4-df7d5106db36 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:20.591414 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c4d4772d-6d1f-461f-a1c9-565f415b51c7 req-2e162fb5-5726-433b-b4e4-df7d5106db36 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 944 time: 0.1355267
Jun 01 11:14:20.713833 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c4d4772d-6d1f-461f-a1c9-565f415b51c7 req-3136f79e-4573-4845-8787-26f0caec85bc tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1039393
Jun 01 11:14:20.751346 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bec0e597-9200-4a1d-86d7-c6f9c5aa6ba1 req-daf437f9-7330-46a5-aae1-d8812b514278 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1589680
Jun 01 11:14:21.207305 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-b02f2a8c-3928-410f-adaa-fa1554c2fcaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:21.208769 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-b02f2a8c-3928-410f-adaa-fa1554c2fcaf tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 815 time: 0.1999245
Jun 01 11:14:21.230334 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0184f5b5-3e38-4dff-930e-70ebbefecb2c req-c0b554ca-9853-4f31-befa-3fd630715580 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:21.231783 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0184f5b5-3e38-4dff-930e-70ebbefecb2c req-c0b554ca-9853-4f31-befa-3fd630715580 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.1466386
Jun 01 11:14:21.233933 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-a1b1b59c-9710-4243-82ca-9c805a678525 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/quotas/a83ba65361364d0fad1aa55a0f8cb7cf HTTP/1.1" status: 200  len: 375 time: 0.0198164
Jun 01 11:14:21.322860 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0184f5b5-3e38-4dff-930e-70ebbefecb2c req-4ea63473-3c52-4348-b378-1a9768705cfe tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0854537
Jun 01 11:14:21.360577 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-5f533a5c-18cd-4324-9488-601c03bfa8ab tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1102617
Jun 01 11:14:21.546118 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-cab6ba7c-40fd-45ac-82d9-41ab9f859f33 service neutron] 10.222.0.74 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1785424
Jun 01 11:14:21.580431 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09889daa-065d-431e-a469-4605f587be7f req-683b8fd6-f8a5-4676-91d2-9830f1ca1de5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:21.581819 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-09889daa-065d-431e-a469-4605f587be7f req-683b8fd6-f8a5-4676-91d2-9830f1ca1de5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.1444595
Jun 01 11:14:21.590167 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36332) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:21.595677 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-65f39d73-4b00-4dee-b199-05b7d48b281c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Request body: {'floatingip': {'port_id': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:21.671326 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65f39d73-4b00-4dee-b199-05b7d48b281c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:21.688503 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36338) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:21.721534 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-acbded1c-0b8c-4b8b-bbb5-89efeddb9f5b service neutron] 10.222.0.74 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1681652
Jun 01 11:14:21.752243 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_v2 [None req-6708a219-1d60-41ee-a355-71a9f762fcbc admin admin] Deleting subnet 3d925639-91b9-4f79-8619-2a656b4099a2 {{(pid=119241) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:14:21.755734 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6708a219-1d60-41ee-a355-71a9f762fcbc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:21.807095 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6708a219-1d60-41ee-a355-71a9f762fcbc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10844045'] for subnet, precommit_delete_associations {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:21.983847 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6f462805-a8b0-4ced-8011-3e1db5b9391b req-da199de5-dca6-4699-adfe-5d51773e4bb9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 210 time: 0.0787237
Jun 01 11:14:21.987376 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6708a219-1d60-41ee-a355-71a9f762fcbc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.085094 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d69521f-43e3-4b3a-bb94-c879c8bc1944 req-2b954922-b910-4bb6-a542-03ed2c9fae79 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:22.086626 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7d69521f-43e3-4b3a-bb94-c879c8bc1944 req-2b954922-b910-4bb6-a542-03ed2c9fae79 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 944 time: 0.2397966
Jun 01 11:14:22.206656 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7d69521f-43e3-4b3a-bb94-c879c8bc1944 req-398cbd65-3fbd-4924-be80-09cba50bcf30 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0739384
Jun 01 11:14:22.312709 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6708a219-1d60-41ee-a355-71a9f762fcbc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10882836', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10623430'] for subnet, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.317955 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-36a52a9e-af87-41ed-8862-771f2d802942 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:22.351333 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65f39d73-4b00-4dee-b199-05b7d48b281c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.357902 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65f39d73-4b00-4dee-b199-05b7d48b281c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.459420 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6708a219-1d60-41ee-a355-71a9f762fcbc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3d925639-91b9-4f79-8619-2a656b4099a2,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:22.461363 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-6708a219-1d60-41ee-a355-71a9f762fcbc admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.463981 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6708a219-1d60-41ee-a355-71a9f762fcbc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:22.468678 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-6708a219-1d60-41ee-a355-71a9f762fcbc admin admin] 10.222.0.74 "DELETE /v2.0/subnets/3d925639-91b9-4f79-8619-2a656b4099a2 HTTP/1.1" status: 204  len: 168 time: 0.7791545
Jun 01 11:14:22.472039 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36354) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:22.540679 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.l3_db [None req-65f39d73-4b00-4dee-b199-05b7d48b281c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Floating IP ac54c94f-1206-4501-9784-16f54659a2a1 associated. External IP: 172.27.3.237, port: e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c.
Jun 01 11:14:22.580038 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.705314 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.712777 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-20b2739f-b512-433a-9eb5-4e6e6c3caeb2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.718462 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f579361c130>,) {'filters': {'network_id': ['73f1ca3d-3f00-45a8-bb61-3d265d008491']}} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:22.730539 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f579361c130>, '04a7072a-bdf8-4e49-a012-f597df9410a5') {'for_net_delete': True} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:22.731092 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f579361c130>, '04a7072a-bdf8-4e49-a012-f597df9410a5') {} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:22.743188 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10844038'] for segment, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.759534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.766473 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Releasing vlan 685 on physical network physnet1 to pool {{(pid=119241) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:14:22.766872 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10959794'] for segment, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]: Traceback (most recent call last):
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     timer()
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     cb(*args, **kw)
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     return func(*args, **kwargs)
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     self._notify()
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     self.callback(batched_events)
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     event.method(event)
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     return f(self, *a, **k)
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._get(url).json()
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:14:22.780106 dv-cinder-787764-3-iscsi neutron-server[119241]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:14:22.859393 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.863833 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-db958257-49d4-4314-b70e-21ac4b471f4d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:22.880207 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:22.890160 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Pushing event deleted for resources: {'Network': ['ID=73f1ca3d-3f00-45a8-bb61-3d265d008491,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:22.893430 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:22.902606 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-1e7cc3b6-73df-433c-95af-c8fa37b99834 admin admin] 10.222.0.74 "DELETE /v2.0/networks/73f1ca3d-3f00-45a8-bb61-3d265d008491 HTTP/1.1" status: 204  len: 168 time: 0.4269598
Jun 01 11:14:23.046964 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65f39d73-4b00-4dee-b199-05b7d48b281c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Router 27b3b506-6634-49e2-b666-8f59cfd9cf96 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:14:23.076630 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36362) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:23.183080 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-872e8661-3dc2-497b-b024-23e1d5756ced req-e104707b-8d13-408e-93ac-3dcf545c764b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 210 time: 0.0701048
Jun 01 11:14:23.196402 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-a1e49397-7512-4336-b9de-24c636f0ccbd admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=7e8afbfddd4f420185db35195f7b5d54&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1182818
Jun 01 11:14:23.208466 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36366) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:23.254037 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65f39d73-4b00-4dee-b199-05b7d48b281c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:14:23.258928 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-65f39d73-4b00-4dee-b199-05b7d48b281c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:23.267252 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] Sync routers for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:14:23.279738 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:23.282070 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798216dc0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:13:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:23.284048 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-af4157b7-87a7-46c2-afa3-14acfb61f1e9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:23.285841 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-af4157b7-87a7-46c2-afa3-14acfb61f1e9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 815 time: 0.2943416
Jun 01 11:14:23.306629 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Request body: {'port': {'device_id': '22c99fe2-9057-4bab-9952-4be03f70b5e1', 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793', 'admin_state_up': True, 'tenant_id': 'a83ba65361364d0fad1aa55a0f8cb7cf'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:23.322398 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7f4b6cef-9600-4b1c-874c-986006a8242b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:23.325520 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-65f39d73-4b00-4dee-b199-05b7d48b281c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "PUT /v2.0/floatingips/ac54c94f-1206-4501-9784-16f54659a2a1 HTTP/1.1" status: 200  len: 992 time: 1.7342684
Jun 01 11:14:23.326314 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:23.329354 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68" -d '{"events": [{"name": "network-changed", "server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:23.459692 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7f4b6cef-9600-4b1c-874c-986006a8242b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:23.484147 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:23.498615 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8e5a1d0-fb23-42c3-a0cf-218a5481efcb x-openstack-request-id: req-d8e5a1d0-fb23-42c3-a0cf-218a5481efcb {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:23.499149 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:23.499537 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-d8e5a1d0-fb23-42c3-a0cf-218a5481efcb {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:23.500113 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'status': 'completed', 'code': 200}
Jun 01 11:14:23.616050 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:23.626014 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7f4b6cef-9600-4b1c-874c-986006a8242b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:23.635257 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-9e453695-ec5c-4f70-9121-37d8acc5ce6c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:23.644193 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:23.662834 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f4b6cef-9600-4b1c-874c-986006a8242b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b802acef-3487-4640-8b16-f6e4055e16d6,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:23.667900 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7f4b6cef-9600-4b1c-874c-986006a8242b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:23.677238 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-287d9773-7901-4eb5-b184-06d99f28fcab req-a86e63ea-e799-4f82-82e5-88ed9b7da6d6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:23.678705 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-287d9773-7901-4eb5-b184-06d99f28fcab req-a86e63ea-e799-4f82-82e5-88ed9b7da6d6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 944 time: 0.2841578
Jun 01 11:14:23.682453 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Made reservation on behalf of a83ba65361364d0fad1aa55a0f8cb7cf for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:14:23.685804 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:23.705617 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7f4b6cef-9600-4b1c-874c-986006a8242b admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:23.706615 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-7f4b6cef-9600-4b1c-874c-986006a8242b admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/b802acef-3487-4640-8b16-f6e4055e16d6 HTTP/1.1" status: 204  len: 168 time: 0.4974349
Jun 01 11:14:23.741534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-048b3c8e-10a7-4a26-ab2f-d6705c4c33e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:23.743013 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-048b3c8e-10a7-4a26-ab2f-d6705c4c33e7 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 1099 time: 0.2106738
Jun 01 11:14:23.809681 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:14:23.833414 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-287d9773-7901-4eb5-b184-06d99f28fcab req-024395aa-06a9-442c-9bdb-b1b69f5310a7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1348734
Jun 01 11:14:23.860522 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798216dc0>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': 'ac54c94f-1206-4501-9784-16f54659a2a1', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'floating_ip_address': '172.27.3.237', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'port_id': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 443, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'mac_address': 'fa:16:3e:dc:95:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:14:00Z', 'updated_at': '2021-06-01T11:14:22Z', 'revision_number': 1, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:23.865740 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] Checking router: 27b3b506-6634-49e2-b666-8f59cfd9cf96 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:14:23.875257 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:23.875906 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798216dc0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:13:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:24.007958 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-b22e4223-2c75-4b05-b8fe-cc39a47db902 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:24.009334 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-b22e4223-2c75-4b05-b8fe-cc39a47db902 service neutron] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 917 time: 0.2291949
Jun 01 11:14:24.023175 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Allocated IP 172.20.0.6 (10ec91f8-5d7c-496e-a32a-4dcea0b24793/6ccfaae8-bb7e-4cdd-ba83-2bee1577d247/4907f837-a38b-48c2-bd58-8cc622deef39) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:24.039084 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 63851119-2409-4ad5-a740-0157c795436f details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:14:24.093286 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:24.151936 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-e8cc94ab-d3e4-42c4-aaf8-9c2a3b5c0d2a service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c HTTP/1.1" status: 200  len: 1000 time: 0.1300349
Jun 01 11:14:24.381310 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 63851119-2409-4ad5-a740-0157c795436f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=63851119-2409-4ad5-a740-0157c795436f,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:24.413940 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '63851119-2409-4ad5-a740-0157c795436f', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'port_id': '63851119-2409-4ad5-a740-0157c795436f', 'mac_address': 'fa:16:3e:1c:61:47', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:14:24.448647 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2d21b290-89bd-4f62-957b-113ff1ef1489 req-f5324f40-09cb-4708-ba34-e9ade9a84310 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 210 time: 0.1055450
Jun 01 11:14:24.460908 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-5992d1ae-ed04-4851-ad31-3297da5d23c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:24.462441 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-5992d1ae-ed04-4851-ad31-3297da5d23c6 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.3041732
Jun 01 11:14:24.551870 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:24.552191 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36404) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:24.576459 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 63851119-2409-4ad5-a740-0157c795436f {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:14:24.579497 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:24.611452 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-934c589d-dd3d-4471-9c0e-451472c03a1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:24.612964 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-934c589d-dd3d-4471-9c0e-451472c03a1a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1301591
Jun 01 11:14:24.620461 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 63851119-2409-4ad5-a740-0157c795436f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=63851119-2409-4ad5-a740-0157c795436f,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:24.649991 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:24.695676 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['7d85ff7b-1fb9-4870-919d-49ce962b290b', '121e5d5e-fe75-481f-9882-768f112ee1f8', '8188fbc7-28fc-4aa3-8f48-39221c1646fb'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:14:24.704988 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d316b7ec-d091-4c51-9198-6253b5423bb3 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:24.727495 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:24.735012 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:24.737090 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1015271761-network', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:24.768533 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:24.787010 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Usage tracker for resource:network and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:24.794101 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:24.805452 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:24.808353 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:24.815358 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:24.822954 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:24.843214 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=63851119-2409-4ad5-a740-0157c795436f,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:24.848038 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:24.866059 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Pushing event updated for resources: {'Port': ['ID=4907f837-a38b-48c2-bd58-8cc622deef39,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:24.877430 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:24.882562 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Made reservation on behalf of 7105d2f283044a3c9f1397f5e07b0bfe for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:14:24.884886 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:24.890461 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798216dc0>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': 'ac54c94f-1206-4501-9784-16f54659a2a1', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'floating_ip_address': '172.27.3.237', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'port_id': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 443, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'mac_address': 'fa:16:3e:dc:95:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:14:00Z', 'updated_at': '2021-06-01T11:14:22Z', 'revision_number': 1, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:24.900332 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e6b306e-9984-4614-8f74-d41a8464d83b None None] The sync data for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi is: [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': 'ac54c94f-1206-4501-9784-16f54659a2a1', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'floating_ip_address': '172.27.3.237', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'port_id': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 443, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'mac_address': 'fa:16:3e:dc:95:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:14:00Z', 'updated_at': '2021-06-01T11:14:22Z', 'revision_number': 1, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:14:24.924805 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:24.939365 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-726f0fe3-cafb-4895-ae7a-c5659c71f178 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3172643
Jun 01 11:14:24.952297 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:24.952947 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:24.960826 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:25.012777 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['63851119-2409-4ad5-a740-0157c795436f'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:14:25.032222 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Usage tracker for resource:security_group_rule and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:25.037439 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:25.111025 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:25.126448 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fa65501-35ec-456d-928f-bb29f261a5dc None None] New status for floating IP ac54c94f-1206-4501-9784-16f54659a2a1: ACTIVE {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:14:25.129096 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.8267112
Jun 01 11:14:25.169565 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Request body: {'port': {'device_id': '22c99fe2-9057-4bab-9952-4be03f70b5e1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:25.260829 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba854fb9-c8a0-4b85-a04e-62009a8eaf68 req-fe395398-6bd7-49de-9c33-1ca9843cf195 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3010428
Jun 01 11:14:25.304858 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-756f82a0-9aff-489d-8b34-020ddf93eea6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:25.350831 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90c0729-1dbe-481c-9339-acfd71038565 req-fc90c71d-8708-4aac-80c8-694a6a0941b9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:25.352106 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:25.352260 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e90c0729-1dbe-481c-9339-acfd71038565 req-fc90c71d-8708-4aac-80c8-694a6a0941b9 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 945 time: 0.3631332
Jun 01 11:14:25.355816 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:25.486838 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:25.490098 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e90c0729-1dbe-481c-9339-acfd71038565 req-f0076f25-63f2-4c33-a25b-3e09fd015cec tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1239707
Jun 01 11:14:25.493016 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:25.497909 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7f4b6cef-9600-4b1c-874c-986006a8242b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:25.579095 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 675}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:14:25.636772 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d266a02f-8fda-45f1-ae8f-b4f9e2374f86,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:25.645202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:25.648706 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:25.649050 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Added segment 58584179-37ca-4343-8b13-9870bf67c2d6 of type vlan for network a30966a5-dc46-445f-8d4a-d8da7c97fafd
Jun 01 11:14:25.762674 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:25.835812 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2593fb8e-8e10-4d34-b9c6-be0ee1f49913 req-e6749136-358d-4daa-b986-5c05a0cf7ae9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:25.836502 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-2593fb8e-8e10-4d34-b9c6-be0ee1f49913 req-e6749136-358d-4daa-b986-5c05a0cf7ae9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Synchronizing usage tracker for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:14:25.851372 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:25.860273 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:25.860844 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:25.870168 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:25.958151 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-2593fb8e-8e10-4d34-b9c6-be0ee1f49913 req-e6749136-358d-4daa-b986-5c05a0cf7ae9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Unset dirty status for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:14:25.959306 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2593fb8e-8e10-4d34-b9c6-be0ee1f49913 req-e6749136-358d-4daa-b986-5c05a0cf7ae9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 931 time: 0.3818724
Jun 01 11:14:25.995694 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Pushing event updated for resources: {'Network': ['ID=a30966a5-dc46-445f-8d4a-d8da7c97fafd,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:25.999009 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.4435933
Jun 01 11:14:26.001992 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36416) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:26.004338 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:26.008073 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network a30966a5-dc46-445f-8d4a-d8da7c97fafd details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:14:26.009581 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Request body: {'subnet': {'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1015271761-subnet', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'ip_version': 4}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:26.014814 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:26.019051 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Usage tracker for resource:subnet and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:26.022390 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:26.029951 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:26.041543 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Made reservation on behalf of 7105d2f283044a3c9f1397f5e07b0bfe for: {'subnet': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:14:26.044820 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-11313286'] for subnet, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.213515 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2593fb8e-8e10-4d34-b9c6-be0ee1f49913 req-d3376f3e-8d23-463b-8c4d-0bffc2a358b3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2478118
Jun 01 11:14:26.236587 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4907f837-a38b-48c2-bd58-8cc622deef39 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:14:26.245318 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.265832 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Transition to ACTIVE for port object 4907f837-a38b-48c2-bd58-8cc622deef39 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:26.271009 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.275931 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7d81a21f-4b8d-448c-978e-3dd9616b9a39 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:26.313749 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-50f26b58-69bb-4aef-b1c3-6becacab3dce service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2029388
Jun 01 11:14:26.397773 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.459581 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10700502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-11313296'] for subnet, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.464339 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b7cc4d8f-fb26-4b59-8c5d-e81903d74fa9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:26.467646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Pushing event updated for resources: {'Port': ['ID=4907f837-a38b-48c2-bd58-8cc622deef39,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:26.506019 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:26.535337 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f490a491-e776-4472-a23c-46b7b609b438,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:26.539377 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:26.543360 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Checking segment: {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:26.543824 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Network hostable DHCP agents. Network: a30966a5-dc46-445f-8d4a-d8da7c97fafd, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119240) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:14:26.563666 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Network a30966a5-dc46-445f-8d4a-d8da7c97fafd is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119240) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:14:26.566260 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Attempting to bind port 4907f837-a38b-48c2-bd58-8cc622deef39 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:14:26.566607 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Attempting to bind port 4907f837-a38b-48c2-bd58-8cc622deef39 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:14:26.566935 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Attempting to bind port 4907f837-a38b-48c2-bd58-8cc622deef39 on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:26.573363 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, a30966a5-dc46-445f-8d4a-d8da7c97fafd) {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:26.574372 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Port 4907f837-a38b-48c2-bd58-8cc622deef39 on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:14:26.574771 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Attempting to bind port 4907f837-a38b-48c2-bd58-8cc622deef39 on network 10ec91f8-5d7c-496e-a32a-4dcea0b24793 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:26.580634 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 14, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:14:26.580847 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Checking segment: {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:26.581194 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Bound using segment: {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:14:26.581625 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Bound port: 4907f837-a38b-48c2-bd58-8cc622deef39, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2030aac5-bed9-4a3d-aab1-8277fcd22311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:14:26.581970 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.584033 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:26.584609 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.588836 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18f60841-e755-4bfd-8735-655afaf807c8 None None] Network a30966a5-dc46-445f-8d4a-d8da7c97fafd requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:14:26.598837 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-46c4180f-e937-46ea-bc5c-d14a563f0cb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:26.600405 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-46c4180f-e937-46ea-bc5c-d14a563f0cb9 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1137 time: 0.1605017
Jun 01 11:14:26.620194 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.6170323
Jun 01 11:14:26.621189 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36422) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:26.627006 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:26.631913 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:26.636276 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Usage tracker for resource:router and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:26.639266 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:26.645365 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:26.660299 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.661489 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.678619 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.839454 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:14:26.840570 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.856430 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] For port 4907f837-a38b-48c2-bd58-8cc622deef39, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:14:26.867010 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-a69dfd93-7807-42cd-826f-edcfdf347e66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:26.868520 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-a69dfd93-7807-42cd-826f-edcfdf347e66 service neutron] 10.222.0.79 "GET /v2.0/networks?id=7356920a-571e-467c-9250-df782b9d8129 HTTP/1.1" status: 200  len: 915 time: 0.2338979
Jun 01 11:14:26.875171 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] For port 4907f837-a38b-48c2-bd58-8cc622deef39, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=4907f837-a38b-48c2-bd58-8cc622deef39,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:14:26.883407 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f8f4258-a9c0-43b2-9c76-08ad20c5b9d7 req-2288bbc9-c212-42de-8d8a-3f97671d9103 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:26.885009 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7f8f4258-a9c0-43b2-9c76-08ad20c5b9d7 req-2288bbc9-c212-42de-8d8a-3f97671d9103 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 945 time: 0.2514267
Jun 01 11:14:26.944527 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:26.948025 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:26.992768 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.017163 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Allocated IP 172.20.0.2 (a30966a5-dc46-445f-8d4a-d8da7c97fafd/f490a491-e776-4472-a23c-46b7b609b438/4ab6cb52-1785-4fdb-bf66-a0fbafc04eda) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:27.057388 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:27.058023 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.059372 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] 10.222.0.79 "PUT /v2.0/ports/4907f837-a38b-48c2-bd58-8cc622deef39 HTTP/1.1" status: 200  len: 1093 time: 1.9027269
Jun 01 11:14:27.062465 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '22c99fe2-9057-4bab-9952-4be03f70b5e1', 'tag': '4907f837-a38b-48c2-bd58-8cc622deef39'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:27.064842 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b135b038-5ef7-4172-a430-cc0e7d20b1d7" -d '{"events": [{"name": "network-changed", "server_uuid": "22c99fe2-9057-4bab-9952-4be03f70b5e1", "tag": "4907f837-a38b-48c2-bd58-8cc622deef39"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:27.104040 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Pushing event updated for resources: {'Port': ['ID=4907f837-a38b-48c2-bd58-8cc622deef39,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:27.108845 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-0b526704-1d67-4ae8-8d1c-3080e65166da service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 1001 time: 0.2226629
Jun 01 11:14:27.111616 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7f8f4258-a9c0-43b2-9c76-08ad20c5b9d7 req-b9552bbb-d343-4182-a5da-36607574c96c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1737463
Jun 01 11:14:27.112498 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:27.182942 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae1ae065-d109-429f-b33f-01a7e44bb74c x-openstack-request-id: req-ae1ae065-d109-429f-b33f-01a7e44bb74c {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:27.183261 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "22c99fe2-9057-4bab-9952-4be03f70b5e1", "tag": "4907f837-a38b-48c2-bd58-8cc622deef39", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:27.183549 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-ae1ae065-d109-429f-b33f-01a7e44bb74c {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:27.183997 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '22c99fe2-9057-4bab-9952-4be03f70b5e1', 'tag': '4907f837-a38b-48c2-bd58-8cc622deef39', 'status': 'completed', 'code': 200}
Jun 01 11:14:27.236726 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-ba571ae8-2756-4093-b2f0-737cf9160752 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:27.238067 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-ba571ae8-2756-4093-b2f0-737cf9160752 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=c5b015bf-9c86-450a-8cbd-8892adfddfb6 HTTP/1.1" status: 200  len: 853 time: 0.1181509
Jun 01 11:14:27.251078 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-5c4a5b82-575e-4df1-9591-72b5668cccd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:27.252557 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-5c4a5b82-575e-4df1-9591-72b5668cccd7 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 1096 time: 0.1314905
Jun 01 11:14:27.267746 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.280273 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Transition to ACTIVE for port object 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:27.301911 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Transition to ACTIVE for port object 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:27.308951 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.322488 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:27.382377 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Network a30966a5-dc46-445f-8d4a-d8da7c97fafd is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:27.386717 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:27.390734 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-16dd088d-7f27-450c-89d6-6c75ad72169b service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4907f837-a38b-48c2-bd58-8cc622deef39 HTTP/1.1" status: 200  len: 217 time: 0.1059299
Jun 01 11:14:27.391209 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:27.433440 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Pushing event updated for resources: {'Port': ['ID=4ab6cb52-1785-4fdb-bf66-a0fbafc04eda,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:27.441978 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:27.494114 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Attempting to bind port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:14:27.494500 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Attempting to bind port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:14:27.494871 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Attempting to bind port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda on network a30966a5-dc46-445f-8d4a-d8da7c97fafd {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:27.495262 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-ad2b5954-507e-4757-ac56-2287f40ef58c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:27.496733 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-ad2b5954-507e-4757-ac56-2287f40ef58c service neutron] 10.222.0.79 "GET /v2.0/subnets?id=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 HTTP/1.1" status: 200  len: 855 time: 0.0886612
Jun 01 11:14:27.501081 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 14, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:14:27.501462 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Checking segment: {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:27.501868 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.502266 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Bound using segment: {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:14:27.502739 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Bound port: 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:14:27.503121 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.507862 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.538314 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.543880 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-bb82098f-4efa-4852-a688-cc543bdcdd22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:27.546940 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-bb82098f-4efa-4852-a688-cc543bdcdd22 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7356920a-571e-467c-9250-df782b9d8129&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2924964
Jun 01 11:14:27.554039 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-1c70983b-de22-4089-a842-9e9ab8fc2b9a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=10ec91f8-5d7c-496e-a32a-4dcea0b24793&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0475442
Jun 01 11:14:27.595514 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] For port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:14:27.598781 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] For port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=4ab6cb52-1785-4fdb-bf66-a0fbafc04eda,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:14:27.603270 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.604395 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbbc274-ab0c-455c-890e-3a356ef1f83f req-2186e5ea-5fb5-48ff-9ce2-30189eef6f05 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:27.605865 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1bbbc274-ab0c-455c-890e-3a356ef1f83f req-2186e5ea-5fb5-48ff-9ce2-30189eef6f05 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 943 time: 0.2560563
Jun 01 11:14:27.616199 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:27.688237 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Allocated IP 172.27.3.158 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/f0df6b1b-fd4f-41af-9da0-3803e4632bd7) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:27.701786 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Pushing event updated for resources: {'Port': ['ID=4ab6cb52-1785-4fdb-bf66-a0fbafc04eda,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:27.705817 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:27.741404 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.857554 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.933027 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:27.937408 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-af49df72-4aaa-470d-bca5-5d6914803401 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:27.951003 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1bbbc274-ab0c-455c-890e-3a356ef1f83f req-a0e0f397-0e88-4bc9-a9b8-9794aac25649 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1715531
Jun 01 11:14:27.986090 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-b7857f26-6be7-43be-a5e8-d0e78dd241bc service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4311547
Jun 01 11:14:28.029361 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-b4eea464-38e0-4b38-aa9c-64c6aa5ca55b service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4532206
Jun 01 11:14:28.037541 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 63851119-2409-4ad5-a740-0157c795436f up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:28.041536 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:28.043192 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:28.059176 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Pushing event updated for resources: {'Port': ['ID=f0df6b1b-fd4f-41af-9da0-3803e4632bd7,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:28.062425 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:28.095735 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:28.121802 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 63851119-2409-4ad5-a740-0157c795436f completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:28.126813 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 63851119-2409-4ad5-a740-0157c795436f triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:28.127262 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:28.234549 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6ce36a8-b4f9-47e9-8a87-516da32a21a7 req-71d47bdf-614d-4535-810b-54842acf4237 service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2373111
Jun 01 11:14:28.275115 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4e68f0bd-d5a3-4b53-8c50-49db849876f3 req-57cc2b3c-ba04-45c9-ab86-0aec1d1edb18 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1979468
Jun 01 11:14:28.292876 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:28.340885 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '63851119-2409-4ad5-a740-0157c795436f'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:28.343330 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81be1778-fc24-4fd6-ac86-b793cf9161a8" -d '{"events": [{"server_uuid": "98a71b50-c504-4fff-86f4-d4d54cee7e31", "name": "network-vif-plugged", "status": "completed", "tag": "63851119-2409-4ad5-a740-0157c795436f"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:28.350811 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 63851119-2409-4ad5-a740-0157c795436f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=63851119-2409-4ad5-a740-0157c795436f,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:28.356601 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:28.358467 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:28.431098 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f809f-fd89-44a3-a4bc-3996e9d0545a req-f5bc24e1-00ca-4150-a716-a006ed89b3a2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:28.440135 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-705f809f-fd89-44a3-a4bc-3996e9d0545a req-f5bc24e1-00ca-4150-a716-a006ed89b3a2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 945 time: 0.1589186
Jun 01 11:14:28.456032 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=63851119-2409-4ad5-a740-0157c795436f,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:28.460745 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:28.544054 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-705f809f-fd89-44a3-a4bc-3996e9d0545a req-7d6b7bd4-ddf2-4e9d-86fc-a0ed3769eefc tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1025782
Jun 01 11:14:28.553915 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:28.570508 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:28.571951 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-991ef165-0209-4586-b92f-f7d6f6a9e773 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:28.573576 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-991ef165-0209-4586-b92f-f7d6f6a9e773 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 1096 time: 0.2203298
Jun 01 11:14:28.661811 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:28.720349 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1dc2bc4d-e10d-43f7-b2aa-2e71d7ecdcbd x-openstack-request-id: req-1dc2bc4d-e10d-43f7-b2aa-2e71d7ecdcbd {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:28.720934 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98a71b50-c504-4fff-86f4-d4d54cee7e31", "name": "network-vif-plugged", "status": "completed", "tag": "63851119-2409-4ad5-a740-0157c795436f", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:28.721432 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-1dc2bc4d-e10d-43f7-b2aa-2e71d7ecdcbd {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:28.722056 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '63851119-2409-4ad5-a740-0157c795436f', 'code': 200}
Jun 01 11:14:28.764904 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-14de8a14-5273-4f2d-b618-ab9f5ad25022 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:28.766361 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-14de8a14-5273-4f2d-b618-ab9f5ad25022 service neutron] 10.222.0.79 "GET /v2.0/networks?id=10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 200  len: 916 time: 0.1778779
Jun 01 11:14:28.878876 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-a7de914d-a2f3-4020-b0b7-925968d72771 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4907f837-a38b-48c2-bd58-8cc622deef39 HTTP/1.1" status: 200  len: 217 time: 0.0799797
Jun 01 11:14:28.934652 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4760ad55-b3a6-4267-912c-5687ab8d2fd1 None None] Network a30966a5-dc46-445f-8d4a-d8da7c97fafd requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:14:28.954029 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-13c23968-21b5-4877-98bc-e58ab5e7431b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:28.956022 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-13c23968-21b5-4877-98bc-e58ab5e7431b service neutron] 10.222.0.79 "GET /v2.0/subnets?id=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 HTTP/1.1" status: 200  len: 855 time: 0.0651927
Jun 01 11:14:28.990629 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:29.043040 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a70a9509-504a-4ff3-8dca-e7618f0b89fc None None] Provisioning for port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:29.050444 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a70a9509-504a-4ff3-8dca-e7618f0b89fc None None] Provisioning complete for port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:29.050825 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a70a9509-504a-4ff3-8dca-e7618f0b89fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:29.098281 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-33271909-8c72-4f32-9ff6-b371fd0a21bb service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=10ec91f8-5d7c-496e-a32a-4dcea0b24793&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1168959
Jun 01 11:14:29.294055 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a70a9509-504a-4ff3-8dca-e7618f0b89fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:29.340965 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19efa07f-a0c0-406d-9c0b-df1f9672d85d req-dd11a643-23e5-47ee-a7aa-54cbebe88aca tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:29.342517 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-19efa07f-a0c0-406d-9c0b-df1f9672d85d req-dd11a643-23e5-47ee-a7aa-54cbebe88aca tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 943 time: 0.2542367
Jun 01 11:14:29.343479 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119240) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:14:29.343643 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a70a9509-504a-4ff3-8dca-e7618f0b89fc None None] For port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=4ab6cb52-1785-4fdb-bf66-a0fbafc04eda,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:29.344527 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fc82921-a6e0-48b5-a944-69caaf01dcce req-e97fc357-c7cb-4b30-ad48-d8afd7e6b0cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:29.345875 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5fc82921-a6e0-48b5-a944-69caaf01dcce req-e97fc357-c7cb-4b30-ad48-d8afd7e6b0cd service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 1099 time: 0.3281503
Jun 01 11:14:29.348272 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-6cf8a812-e9e6-45cf-bed4-3c7079b989c8 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2050784
Jun 01 11:14:29.353537 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a70a9509-504a-4ff3-8dca-e7618f0b89fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:29.356153 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:29.425812 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a70a9509-504a-4ff3-8dca-e7618f0b89fc None None] Pushing event updated for resources: {'Port': ['ID=4ab6cb52-1785-4fdb-bf66-a0fbafc04eda,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:29.428687 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a70a9509-504a-4ff3-8dca-e7618f0b89fc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:29.524223 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-19efa07f-a0c0-406d-9c0b-df1f9672d85d req-0ab168ac-50e3-4ea5-bafa-b8c28b2c03a9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1702237
Jun 01 11:14:29.547627 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5fc82921-a6e0-48b5-a944-69caaf01dcce req-bb8002f3-94cf-4bfd-97c8-a0df613442eb service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1718667
Jun 01 11:14:29.547788 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:14:29.556802 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Sync routers for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:14:29.567434 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:29.568238 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57981a3f40>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:29.574643 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:29.578528 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 2.9539559
Jun 01 11:14:29.578768 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36446) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:29.587840 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b135b038-5ef7-4172-a430-cc0e7d20b1d7 req-910e3b43-6794-4602-9661-6ff4a7feaae8 service neutron] 10.222.0.79 "GET /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2184639
Jun 01 11:14:29.764556 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-dfe1c70b-84e4-489f-8076-4d72b6d3caa8 None None] Provisioning complete for port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:29.764843 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-dfe1c70b-84e4-489f-8076-4d72b6d3caa8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:29.830438 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:29.849619 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf74f4e8-448f-445e-b075-0188906bc176 req-175ec358-1199-4bea-ada5-1ceb518c11ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:29.851082 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bf74f4e8-448f-445e-b075-0188906bc176 req-175ec358-1199-4bea-ada5-1ceb518c11ca tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 946 time: 0.1754582
Jun 01 11:14:29.896638 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bf74f4e8-448f-445e-b075-0188906bc176 req-fde8f1b2-e6ca-4421-b8d0-dcc8700986c4 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397470
Jun 01 11:14:30.164854 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57981a3f40>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:28Z', 'revision_number': 3, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:30.168649 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Checking router: 5fb046d6-be4d-48d1-adb9-9caf08ce3958 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:14:30.168999 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Updating router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 port f0df6b1b-fd4f-41af-9da0-3803e4632bd7 binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:14:30.222151 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:30.271039 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:30.466368 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:30.483039 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Allocated IP 172.20.0.1 (a30966a5-dc46-445f-8d4a-d8da7c97fafd/f490a491-e776-4472-a23c-46b7b609b438/c9797d4e-1313-43c6-9564-044af9755d12) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:30.590461 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:30.590842 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:30.641186 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:30.660047 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Transition to ACTIVE for port object c9797d4e-1313-43c6-9564-044af9755d12 will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:30.698635 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:30.706107 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b246143c-9e41-43c7-81d0-ecf490c9284e tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:30.736451 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:30.770565 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Network a30966a5-dc46-445f-8d4a-d8da7c97fafd is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:30.773628 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:30.780728 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:30.786297 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Transition to ACTIVE for port object f0df6b1b-fd4f-41af-9da0-3803e4632bd7 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:30.789690 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a197ee82-a0a0-4958-992b-58ae96393e07 req-c32cde47-4067-4396-92d7-28e4b5e62864 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:30.799142 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a197ee82-a0a0-4958-992b-58ae96393e07 req-c32cde47-4067-4396-92d7-28e4b5e62864 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 943 time: 0.1180730
Jun 01 11:14:30.805119 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:30.815112 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:30.824057 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Pushing event updated for resources: {'Port': ['ID=c9797d4e-1313-43c6-9564-044af9755d12,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:30.828959 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:30.860694 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a197ee82-a0a0-4958-992b-58ae96393e07 req-7bcbd767-7dee-4d78-a07e-3f1e2f9f527f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0605192
Jun 01 11:14:30.916122 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Attempting to bind port f0df6b1b-fd4f-41af-9da0-3803e4632bd7 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:14:30.916640 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Attempting to bind port f0df6b1b-fd4f-41af-9da0-3803e4632bd7 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:14:30.916867 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Attempting to bind port f0df6b1b-fd4f-41af-9da0-3803e4632bd7 on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:30.921283 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25bf6bea-4c44-4a56-9ddb-5d5298a9e0de None None] Pushing event updated for resources: {'Port': ['ID=f0df6b1b-fd4f-41af-9da0-3803e4632bd7,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:30.924208 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-25bf6bea-4c44-4a56-9ddb-5d5298a9e0de None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:30.929278 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 14, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:14:30.929483 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:30.929876 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:30.930483 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:14:30.930770 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Bound port: f0df6b1b-fd4f-41af-9da0-3803e4632bd7, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:14:30.931155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:30.962102 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:31.020895 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] For port f0df6b1b-fd4f-41af-9da0-3803e4632bd7, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:14:31.025562 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] For port f0df6b1b-fd4f-41af-9da0-3803e4632bd7, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f0df6b1b-fd4f-41af-9da0-3803e4632bd7,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:14:31.031073 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:31.035780 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-27928898-ebc2-4603-bea1-9d50c31dcd9c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:31.072083 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-67bb6283-be3e-4f47-a774-0047f46c804b None None] Provisioning for port c9797d4e-1313-43c6-9564-044af9755d12 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:31.098302 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-67bb6283-be3e-4f47-a774-0047f46c804b None None] Provisioning complete for port c9797d4e-1313-43c6-9564-044af9755d12 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:31.098533 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-67bb6283-be3e-4f47-a774-0047f46c804b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:31.113488 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826c471b-a349-4d18-8748-c51414f5ffd0 req-6caa8452-78b3-4a67-a11b-52655ae465d3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:31.115964 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-826c471b-a349-4d18-8748-c51414f5ffd0 req-6caa8452-78b3-4a67-a11b-52655ae465d3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 946 time: 0.0874729
Jun 01 11:14:31.167960 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-826c471b-a349-4d18-8748-c51414f5ffd0 req-d996c1bc-1c6f-4981-b947-7dfc2fd0adc3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0455756
Jun 01 11:14:31.169066 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:31.169817 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57981a3f40>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:31.224655 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:31.227542 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25bf6bea-4c44-4a56-9ddb-5d5298a9e0de None None] Pushing event updated for resources: {'Port': ['ID=f0df6b1b-fd4f-41af-9da0-3803e4632bd7,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:31.238499 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-25bf6bea-4c44-4a56-9ddb-5d5298a9e0de None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:31.239077 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-67bb6283-be3e-4f47-a774-0047f46c804b None None] Port c9797d4e-1313-43c6-9564-044af9755d12 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:14:31.360437 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:31.366700 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4552eaa3-1885-4096-810a-4ded004c2006 req-cfb4c54b-477a-4ca7-abf9-99b3b576dd5b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:31.368200 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4552eaa3-1885-4096-810a-4ded004c2006 req-cfb4c54b-477a-4ca7-abf9-99b3b576dd5b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 946 time: 0.0953662
Jun 01 11:14:31.379129 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36460) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:31.391636 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-d443904b-8551-4997-b4f0-cee380725013 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Request body: {'floatingip': {'port_id': '63851119-2409-4ad5-a740-0157c795436f'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:31.475486 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-d443904b-8551-4997-b4f0-cee380725013 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:31.675823 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57981a3f40>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:30Z', 'revision_number': 1, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:31.679809 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eb8a3d3-e201-4b73-8127-4bdb8f1c87da None None] The sync data for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi is: [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:30Z', 'revision_number': 1, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:14:31.698669 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:31.707669 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:31.783922 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7e75ca70-2787-4e0e-b374-e9b4e68c1180 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:31.893186 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Pushing event updated for resources: {'Port': ['ID=c9797d4e-1313-43c6-9564-044af9755d12,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:31.946818 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:31.968764 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:32.052776 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 4907f837-a38b-48c2-bd58-8cc622deef39 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:14:32.086199 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd395ea-3cae-41f5-9c67-6b4d6e4cdb32 req-01ccfc11-11ff-4b66-9655-580b92ff6ade tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:32.088363 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8bd395ea-3cae-41f5-9c67-6b4d6e4cdb32 req-01ccfc11-11ff-4b66-9655-580b92ff6ade tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 943 time: 0.0949371
Jun 01 11:14:32.144883 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8bd395ea-3cae-41f5-9c67-6b4d6e4cdb32 req-a07ec8d4-c7f9-4f3f-984d-be986c7afe56 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0505981
Jun 01 11:14:32.213783 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 4907f837-a38b-48c2-bd58-8cc622deef39, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=4907f837-a38b-48c2-bd58-8cc622deef39,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:32.233807 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '4907f837-a38b-48c2-bd58-8cc622deef39', 'network_id': '10ec91f8-5d7c-496e-a32a-4dcea0b24793', 'port_id': '4907f837-a38b-48c2-bd58-8cc622deef39', 'mac_address': 'fa:16:3e:e9:f1:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 682, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6ccfaae8-bb7e-4cdd-ba83-2bee1577d247', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:14:32.251296 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Network a30966a5-dc46-445f-8d4a-d8da7c97fafd is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:32.253386 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:32.305653 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:32.326939 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4907f837-a38b-48c2-bd58-8cc622deef39 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:14:32.346655 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 4907f837-a38b-48c2-bd58-8cc622deef39, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=4907f837-a38b-48c2-bd58-8cc622deef39,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:32.356735 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:32.359160 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:32.475784 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=4907f837-a38b-48c2-bd58-8cc622deef39,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:32.482631 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:32.552920 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f0df6b1b-fd4f-41af-9da0-3803e4632bd7 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:32.632743 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-d443904b-8551-4997-b4f0-cee380725013 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:32.679536 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-aa95bb6e-8824-4464-85d7-95c10cf15a4c None None] Provisioning complete for port c9797d4e-1313-43c6-9564-044af9755d12 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:32.680230 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-aa95bb6e-8824-4464-85d7-95c10cf15a4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:32.703475 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-d443904b-8551-4997-b4f0-cee380725013 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:32.739793 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['4907f837-a38b-48c2-bd58-8cc622deef39'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:14:32.792318 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-aa95bb6e-8824-4464-85d7-95c10cf15a4c None None] Port c9797d4e-1313-43c6-9564-044af9755d12 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:14:32.793777 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port f0df6b1b-fd4f-41af-9da0-3803e4632bd7 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:32.802674 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port f0df6b1b-fd4f-41af-9da0-3803e4632bd7 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:32.803061 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:32.890650 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:14:32.972978 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.l3_db [None req-d443904b-8551-4997-b4f0-cee380725013 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Floating IP 8e5712a1-35b2-4f01-a2cc-543cbca04819 associated. External IP: 172.27.3.209, port: 63851119-2409-4ad5-a740-0157c795436f.
Jun 01 11:14:32.993109 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:33.030558 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port f0df6b1b-fd4f-41af-9da0-3803e4632bd7, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f0df6b1b-fd4f-41af-9da0-3803e4632bd7,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:33.043082 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:33.048587 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-faee2c78-f49a-46a0-bc02-f431ca92d74a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:33.121486 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=f0df6b1b-fd4f-41af-9da0-3803e4632bd7,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:33.125268 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:33.248606 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:14:33.315479 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] 10.222.0.74 "PUT /v2.0/routers/5fb046d6-be4d-48d1-adb9-9caf08ce3958/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.7355626
Jun 01 11:14:33.340121 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc15bad4-af2e-4e74-bf9f-f36e90a94b3a req-bc2b3ab8-175b-499e-b152-945e630f9bc1 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:33.343330 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fc15bad4-af2e-4e74-bf9f-f36e90a94b3a req-bc2b3ab8-175b-499e-b152-945e630f9bc1 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 944 time: 0.0920501
Jun 01 11:14:33.392496 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fc15bad4-af2e-4e74-bf9f-f36e90a94b3a req-27d1d862-60e9-4c26-9c82-95da81fad5ec tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431652
Jun 01 11:14:33.446436 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d443904b-8551-4997-b4f0-cee380725013 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Router abf03e4b-fdd0-44b3-86be-277da7892b4a has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:14:33.637087 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d443904b-8551-4997-b4f0-cee380725013 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:14:33.641490 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-d443904b-8551-4997-b4f0-cee380725013 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:33.653239 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] Sync routers for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:14:33.664436 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:33.665055 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798378f70>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:33.712152 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-d443904b-8551-4997-b4f0-cee380725013 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "PUT /v2.0/floatingips/8e5712a1-35b2-4f01-a2cc-543cbca04819 HTTP/1.1" status: 200  len: 992 time: 2.3317373
Jun 01 11:14:33.712899 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'tag': '63851119-2409-4ad5-a740-0157c795436f'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:33.718432 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3743d3d6-8348-4509-86ff-e40735cfd855" -d '{"events": [{"name": "network-changed", "server_uuid": "98a71b50-c504-4fff-86f4-d4d54cee7e31", "tag": "63851119-2409-4ad5-a740-0157c795436f"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:33.862386 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36490) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:33.868335 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1470422257-network', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:33.873945 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:33.878299 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Usage tracker for resource:network and tenant:41dbddfbf95248d5a754fbd84e666185 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:33.885828 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:33.888845 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:33.893325 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:33.903558 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Made reservation on behalf of 41dbddfbf95248d5a754fbd84e666185 for: {'network': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:14:33.905981 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:33.918475 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:33.933915 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:33.939135 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Usage tracker for resource:security_group_rule and tenant:41dbddfbf95248d5a754fbd84e666185 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:33.941762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:33.946563 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Sync routers for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:14:33.948734 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:33.959832 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:33.960568 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579835eca0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:34.144713 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 4907f837-a38b-48c2-bd58-8cc622deef39 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:34.156784 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.162675 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.167012 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fcfb3c9e-8b6d-4492-9beb-be86176cf8cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:34.199524 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34becf3e-ecd6-44e4-aa93-b0c1215e2b1f x-openstack-request-id: req-34becf3e-ecd6-44e4-aa93-b0c1215e2b1f {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:34.201372 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "98a71b50-c504-4fff-86f4-d4d54cee7e31", "tag": "63851119-2409-4ad5-a740-0157c795436f", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:34.201588 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-34becf3e-ecd6-44e4-aa93-b0c1215e2b1f {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:34.201968 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'tag': '63851119-2409-4ad5-a740-0157c795436f', 'status': 'completed', 'code': 200}
Jun 01 11:14:34.207528 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 651}  {{(pid=119240) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:14:34.213650 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=400c076f-df06-4301-9de7-f33cff49cc46,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:34.218651 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:34.223141 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.223913 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.segments_db [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Added segment 809c0da7-01a9-42fc-9673-27dab824c772 of type vlan for network 752d795b-2d24-4813-8699-de94831f729d
Jun 01 11:14:34.231523 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:34.259169 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.300398 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.302698 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:34.303114 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.309283 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798378f70>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '8e5712a1-35b2-4f01-a2cc-543cbca04819', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'port_id': '63851119-2409-4ad5-a740-0157c795436f', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'mac_address': 'fa:16:3e:1c:61:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:14:13Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 1, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:34.315952 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] Checking router: abf03e4b-fdd0-44b3-86be-277da7892b4a for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:14:34.329370 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:34.330328 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798378f70>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:34.333504 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:34.337240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-69f5d782-0e56-46db-b2a7-dee8331cc248 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:34.339350 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-69f5d782-0e56-46db-b2a7-dee8331cc248 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=22a029b4c9f84f4191259891ac3af6c3&device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 1099 time: 0.0894628
Jun 01 11:14:34.353990 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.4904182
Jun 01 11:14:34.368489 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 4907f837-a38b-48c2-bd58-8cc622deef39 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:34.386279 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36496) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:34.396594 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 4907f837-a38b-48c2-bd58-8cc622deef39 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:34.396925 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.404675 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Request body: {'subnet': {'network_id': '752d795b-2d24-4813-8699-de94831f729d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1470422257-subnet', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:34.411871 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:34.494794 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f0df6b1b-fd4f-41af-9da0-3803e4632bd7 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:34.501306 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Usage tracker for resource:subnet and tenant:41dbddfbf95248d5a754fbd84e666185 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:34.507610 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:34.515448 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Pushing event updated for resources: {'Network': ['ID=752d795b-2d24-4813-8699-de94831f729d,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:34.518282 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:34.531934 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:34.536641 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 752d795b-2d24-4813-8699-de94831f729d details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:14:34.564507 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Made reservation on behalf of 41dbddfbf95248d5a754fbd84e666185 for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:14:34.567406 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10623449'] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.593927 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:34.717150 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-5165b6f0-b128-42b1-83d0-eac1dba5d0a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:34.718829 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-5165b6f0-b128-42b1-83d0-eac1dba5d0a6 service neutron] 10.222.0.79 "GET /v2.0/networks?id=418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 200  len: 911 time: 0.3662739
Jun 01 11:14:34.816932 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port f0df6b1b-fd4f-41af-9da0-3803e4632bd7 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:34.817314 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.868822 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-131e1a02-5f5e-486e-b64c-52072f1585d1 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=63851119-2409-4ad5-a740-0157c795436f HTTP/1.1" status: 200  len: 1000 time: 0.1395743
Jun 01 11:14:34.877076 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d42c14bb-f722-4d3b-8828-60d2f609ae56 req-f1db8251-ff6a-45a3-bab0-686075333323 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:34.878539 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d42c14bb-f722-4d3b-8828-60d2f609ae56 req-f1db8251-ff6a-45a3-bab0-686075333323 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 944 time: 0.3197570
Jun 01 11:14:34.879364 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.924045 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '22c99fe2-9057-4bab-9952-4be03f70b5e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4907f837-a38b-48c2-bd58-8cc622deef39'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:34.926305 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6cfe415-5957-4d11-bac6-3ea0525c8379" -d '{"events": [{"server_uuid": "22c99fe2-9057-4bab-9952-4be03f70b5e1", "name": "network-vif-plugged", "status": "completed", "tag": "4907f837-a38b-48c2-bd58-8cc622deef39"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:34.939165 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 4907f837-a38b-48c2-bd58-8cc622deef39, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=4907f837-a38b-48c2-bd58-8cc622deef39,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:34.971714 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-8b4b398d-2803-4722-ad1c-0dfc51b2b63b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:34.974368 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-8b4b398d-2803-4722-ad1c-0dfc51b2b63b service neutron] 10.222.0.79 "GET /v2.0/subnets?id=08c4a15d-0d06-4d4b-909f-10ac28c5c16c HTTP/1.1" status: 200  len: 849 time: 0.0936828
Jun 01 11:14:34.975192 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798378f70>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '8e5712a1-35b2-4f01-a2cc-543cbca04819', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'port_id': '63851119-2409-4ad5-a740-0157c795436f', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'mac_address': 'fa:16:3e:1c:61:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:14:13Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 1, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:34.975742 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:34.981839 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75ca2051-04de-4291-83b2-5a9fdeb1961e None None] The sync data for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi is: [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '8e5712a1-35b2-4f01-a2cc-543cbca04819', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'port_id': '63851119-2409-4ad5-a740-0157c795436f', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'mac_address': 'fa:16:3e:1c:61:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:14:13Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 1, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:14:34.983025 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-2e953603-8a2b-44dc-bc67-b1b9be738cf4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:35.016991 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579835eca0>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 2, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:35.099515 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Checking router: 5fb046d6-be4d-48d1-adb9-9caf08ce3958 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:14:35.099907 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Updating router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 port c9797d4e-1313-43c6-9564-044af9755d12 binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:14:35.131254 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d42c14bb-f722-4d3b-8828-60d2f609ae56 req-67294b86-9e00-41aa-ba7f-a6d3ce3a299e tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1546612
Jun 01 11:14:35.161534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-4034599a-3ea5-419f-adae-279999b1aed6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:35.163010 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-4034599a-3ea5-419f-adae-279999b1aed6 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=418faffe-faca-4025-ab0f-56771435263e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1619608
Jun 01 11:14:35.168302 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=4907f837-a38b-48c2-bd58-8cc622deef39,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:35.173519 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:35.174113 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:35.228748 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c6c2104-4446-4fc3-8d13-369c3060b97d x-openstack-request-id: req-5c6c2104-4446-4fc3-8d13-369c3060b97d {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:35.229060 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "22c99fe2-9057-4bab-9952-4be03f70b5e1", "name": "network-vif-plugged", "status": "completed", "tag": "4907f837-a38b-48c2-bd58-8cc622deef39", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:35.229326 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-5c6c2104-4446-4fc3-8d13-369c3060b97d {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:35.229716 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '22c99fe2-9057-4bab-9952-4be03f70b5e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4907f837-a38b-48c2-bd58-8cc622deef39', 'code': 200}
Jun 01 11:14:35.265630 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e3e58f6-0fce-4c7e-902b-39c3f8281992 None None] New status for floating IP 8e5712a1-35b2-4f01-a2cc-543cbca04819: ACTIVE {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:14:35.320327 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-cad98497-ce1d-4521-ab1b-2ec7c1d7cb2f service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1400752
Jun 01 11:14:35.572577 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:35.587836 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Transition to ACTIVE for port object c9797d4e-1313-43c6-9564-044af9755d12 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:35.598011 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:35.603420 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-0b7ff5f5-69c3-4d8a-bcae-d6c9c98113df None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:35.724860 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b9e405-894f-45cd-af3e-c75c3f01d210 req-647f2250-9b7c-4ec7-89a7-ffb8c55a5c11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:35.726343 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6b9e405-894f-45cd-af3e-c75c3f01d210 req-647f2250-9b7c-4ec7-89a7-ffb8c55a5c11 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 1098 time: 0.3008442
Jun 01 11:14:35.728232 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3743d3d6-8348-4509-86ff-e40735cfd855 req-a147d264-677e-4002-ba13-4b16dc72f0a1 service neutron] 10.222.0.79 "GET /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3935778
Jun 01 11:14:35.799915 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6b9e405-894f-45cd-af3e-c75c3f01d210 req-8c77ac9a-7c2c-47c9-a7f8-dffc7c8a7798 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0591795
Jun 01 11:14:35.813576 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55429625-eec9-452c-8080-e8afbd45ccd6 None None] Pushing event updated for resources: {'Port': ['ID=c9797d4e-1313-43c6-9564-044af9755d12,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:35.815851 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-55429625-eec9-452c-8080-e8afbd45ccd6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:35.839693 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Attempting to bind port c9797d4e-1313-43c6-9564-044af9755d12 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:14:35.839989 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Attempting to bind port c9797d4e-1313-43c6-9564-044af9755d12 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:14:35.840365 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Attempting to bind port c9797d4e-1313-43c6-9564-044af9755d12 on network a30966a5-dc46-445f-8d4a-d8da7c97fafd {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:35.846768 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 14, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:14:35.847359 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Checking segment: {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:35.847701 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:35.848106 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Bound using segment: {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:14:35.848742 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Bound port: c9797d4e-1313-43c6-9564-044af9755d12, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:14:35.849131 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:35.868206 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10882903', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10623439'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:35.873474 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:35.944207 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3b5f5f5b-e070-408f-acb0-c059a55b7236,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:35.956055 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.956423 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.956784 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.957136 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.957485 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.957672 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] For port c9797d4e-1313-43c6-9564-044af9755d12, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:14:35.957835 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.958162 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.958519 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.958859 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.959197 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.959567 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.960009 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:35.962968 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] For port c9797d4e-1313-43c6-9564-044af9755d12, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=c9797d4e-1313-43c6-9564-044af9755d12,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:14:35.965708 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:35.966293 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Checking segment: {'id': '809c0da7-01a9-42fc-9673-27dab824c772', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '752d795b-2d24-4813-8699-de94831f729d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:35.966740 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Network hostable DHCP agents. Network: 752d795b-2d24-4813-8699-de94831f729d, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:14:35.966872 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:35.970622 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:35.987963 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Network 752d795b-2d24-4813-8699-de94831f729d is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:14:35.998267 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 752d795b-2d24-4813-8699-de94831f729d) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:36.008912 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:36.009536 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:36.015482 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf9d58ac-0bd0-4cc7-a2f8-b21345b4bb96 None None] Network 752d795b-2d24-4813-8699-de94831f729d requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:14:36.031949 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c87cb4dd-8e47-4538-a1ac-2d061cb282c3 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.6404119
Jun 01 11:14:36.034659 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36508) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:36.041630 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:36.048103 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:36.056764 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Usage tracker for resource:router and tenant:41dbddfbf95248d5a754fbd84e666185 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:36.060729 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:36.067085 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:36.080231 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:36.082828 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:36.101367 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:36.144877 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:36.145529 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579835eca0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:36.353878 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55429625-eec9-452c-8080-e8afbd45ccd6 None None] Pushing event updated for resources: {'Port': ['ID=c9797d4e-1313-43c6-9564-044af9755d12,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:36.361506 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27f0a794-1e78-49dc-8a81-0a917ce1921c req-1aef101e-9c51-4bda-8730-36638ba86c31 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:36.363082 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-55429625-eec9-452c-8080-e8afbd45ccd6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.392s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:36.372061 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-27f0a794-1e78-49dc-8a81-0a917ce1921c req-1aef101e-9c51-4bda-8730-36638ba86c31 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 945 time: 0.1048806
Jun 01 11:14:36.395540 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:36.423981 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:36.432472 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-27f0a794-1e78-49dc-8a81-0a917ce1921c req-0dc960e3-084f-43d0-85a2-b9972178ebc9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0616033
Jun 01 11:14:36.506992 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device c9797d4e-1313-43c6-9564-044af9755d12 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:36.744143 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:36.775459 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:36.797798 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-752d795b-2d24-4813-8699-de94831f729d', 'network_id': '752d795b-2d24-4813-8699-de94831f729d', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'fixed_ips': [{'subnet_id': '3b5f5f5b-e070-408f-acb0-c059a55b7236'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:14:36.798618 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:36.887757 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port c9797d4e-1313-43c6-9564-044af9755d12 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:36.920732 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port c9797d4e-1313-43c6-9564-044af9755d12 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:36.921125 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:36.925206 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Allocated IP 172.27.3.6 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/a8101963-8b0b-49ed-a2c5-db4a1a0c93a0) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:37.073633 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.106828 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.111379 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d5095996-dade-471d-bbc5-5af781f7fb0e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:37.157927 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Allocated IP 172.20.0.2 (752d795b-2d24-4813-8699-de94831f729d/3b5f5f5b-e070-408f-acb0-c059a55b7236/4634c1b1-c304-4ba1-8838-1ca98077fc34) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:37.173271 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:37.176479 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:37.181635 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:37.186102 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579835eca0>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:35Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:37.191525 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.207955 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c20e334-027d-4e53-adc6-ba4acefd9382 None None] The sync data for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi is: [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:35Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:14:37.237901 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Pushing event updated for resources: {'Port': ['ID=a8101963-8b0b-49ed-a2c5-db4a1a0c93a0,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:37.241463 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:37.311030 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port c9797d4e-1313-43c6-9564-044af9755d12, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=c9797d4e-1313-43c6-9564-044af9755d12,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:37.332018 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.336655 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-55429625-eec9-452c-8080-e8afbd45ccd6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:37.499188 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=c9797d4e-1313-43c6-9564-044af9755d12,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:37.526047 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:37.537602 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.549059 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Transition to ACTIVE for port object 4634c1b1-c304-4ba1-8838-1ca98077fc34 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:37.579815 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Transition to ACTIVE for port object 4634c1b1-c304-4ba1-8838-1ca98077fc34 will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:37.586908 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.596679 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:37.670387 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Pushing event updated for resources: {'Port': ['ID=4634c1b1-c304-4ba1-8838-1ca98077fc34,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:37.684692 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:37.692484 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Network 752d795b-2d24-4813-8699-de94831f729d is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:37.695531 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:37.701872 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:37.743916 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837a6591-bb7a-45c8-b0be-45b2fdf26b72 req-0f1fff40-0cc0-4613-ad8b-02dcee430f5f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:37.745434 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-837a6591-bb7a-45c8-b0be-45b2fdf26b72 req-0f1fff40-0cc0-4613-ad8b-02dcee430f5f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 945 time: 0.0982661
Jun 01 11:14:37.794890 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-837a6591-bb7a-45c8-b0be-45b2fdf26b72 req-be534460-fde7-42ef-a2b1-93ab56295fec tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435317
Jun 01 11:14:37.819489 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Attempting to bind port 4634c1b1-c304-4ba1-8838-1ca98077fc34 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:14:37.819905 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Attempting to bind port 4634c1b1-c304-4ba1-8838-1ca98077fc34 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '809c0da7-01a9-42fc-9673-27dab824c772', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '752d795b-2d24-4813-8699-de94831f729d'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:14:37.820351 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Attempting to bind port 4634c1b1-c304-4ba1-8838-1ca98077fc34 on network 752d795b-2d24-4813-8699-de94831f729d {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:37.827319 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 14, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:14:37.827931 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Checking segment: {'id': '809c0da7-01a9-42fc-9673-27dab824c772', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '752d795b-2d24-4813-8699-de94831f729d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:37.828431 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.828938 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Bound using segment: {'id': '809c0da7-01a9-42fc-9673-27dab824c772', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '752d795b-2d24-4813-8699-de94831f729d'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:14:37.829514 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Bound port: 4634c1b1-c304-4ba1-8838-1ca98077fc34, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '809c0da7-01a9-42fc-9673-27dab824c772', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '752d795b-2d24-4813-8699-de94831f729d'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:14:37.830001 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.835901 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.937694 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] For port 4634c1b1-c304-4ba1-8838-1ca98077fc34, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:14:37.941441 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] For port 4634c1b1-c304-4ba1-8838-1ca98077fc34, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=4634c1b1-c304-4ba1-8838-1ca98077fc34,segment=NetworkSegment(809c0da7-01a9-42fc-9673-27dab824c772),segment_id=809c0da7-01a9-42fc-9673-27dab824c772)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:14:37.948751 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:37.956766 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:38.048618 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Pushing event updated for resources: {'Port': ['ID=4634c1b1-c304-4ba1-8838-1ca98077fc34,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:38.052021 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:38.244416 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:38.508402 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Router 0791e9cb-453f-46b2-8069-4d3ba2947899 is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119240) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:14:38.533485 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device c9797d4e-1313-43c6-9564-044af9755d12 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:38.622070 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port c9797d4e-1313-43c6-9564-044af9755d12 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:38.622442 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:38.728384 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:14:38.740847 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Sync routers for ids ['0791e9cb-453f-46b2-8069-4d3ba2947899'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:14:38.750670 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:38.754827 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 919 time: 2.7191603
Jun 01 11:14:38.755668 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36534) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:38.771098 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Routers {'0791e9cb-453f-46b2-8069-4d3ba2947899'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:38.771768 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57982e1040>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['0791e9cb-453f-46b2-8069-4d3ba2947899'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:38.828384 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 4634c1b1-c304-4ba1-8838-1ca98077fc34 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:39.004172 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 4634c1b1-c304-4ba1-8838-1ca98077fc34 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:39.015208 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Set router 0791e9cb-453f-46b2-8069-4d3ba2947899 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:39.154194 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83a1c8fe-8699-4948-982b-dbf892a2ca22 None None] Network 752d795b-2d24-4813-8699-de94831f729d requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:14:39.309019 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-38f15796-245b-450a-90b1-73e6a44ef92f None None] Provisioning for port 4634c1b1-c304-4ba1-8838-1ca98077fc34 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:39.329184 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-38f15796-245b-450a-90b1-73e6a44ef92f None None] Provisioning complete for port 4634c1b1-c304-4ba1-8838-1ca98077fc34 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:39.329558 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-38f15796-245b-450a-90b1-73e6a44ef92f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:39.453394 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:39.659818 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-38f15796-245b-450a-90b1-73e6a44ef92f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:39.674031 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Allocated IP 172.20.0.1 (752d795b-2d24-4813-8699-de94831f729d/3b5f5f5b-e070-408f-acb0-c059a55b7236/b3466c6d-ebf3-44dd-9234-ecea275a28d0) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:14:39.679081 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57982e1040>, [{'id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:37Z', 'revision_number': 3, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'gw_port': {'id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:dc:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:39.693649 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Checking router: 0791e9cb-453f-46b2-8069-4d3ba2947899 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:14:39.694065 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Updating router 0791e9cb-453f-46b2-8069-4d3ba2947899 port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:14:39.758847 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-38f15796-245b-450a-90b1-73e6a44ef92f None None] For port 4634c1b1-c304-4ba1-8838-1ca98077fc34, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=4634c1b1-c304-4ba1-8838-1ca98077fc34,segment=NetworkSegment(809c0da7-01a9-42fc-9673-27dab824c772),segment_id=809c0da7-01a9-42fc-9673-27dab824c772)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:39.767524 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-38f15796-245b-450a-90b1-73e6a44ef92f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:39.769289 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:39.799219 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:39.986952 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f15796-245b-450a-90b1-73e6a44ef92f None None] Pushing event updated for resources: {'Port': ['ID=4634c1b1-c304-4ba1-8838-1ca98077fc34,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:39.997207 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-38f15796-245b-450a-90b1-73e6a44ef92f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:40.032014 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.060022 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Transition to ACTIVE for port object b3466c6d-ebf3-44dd-9234-ecea275a28d0 will not be triggered until provisioned by entity DHCP. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:40.087260 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.093619 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3e2cd375-13ad-4034-b907-f46258712ee5 tempest-VolumesSnapshotTestJSON-50868828 tempest-VolumesSnapshotTestJSON-50868828-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:40.156686 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9e38f3f5-2b09-4b8d-b496-2d134042a3a4 None None] Provisioning complete for port 4634c1b1-c304-4ba1-8838-1ca98077fc34 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:40.157096 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9e38f3f5-2b09-4b8d-b496-2d134042a3a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.161011 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Network 752d795b-2d24-4813-8699-de94831f729d is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:40.164183 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:40.168026 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:14:40.204512 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Pushing event updated for resources: {'Port': ['ID=b3466c6d-ebf3-44dd-9234-ecea275a28d0,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:40.208907 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:40.229906 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.364871 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.380744 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.393037 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Transition to ACTIVE for port object a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:40.400068 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.404179 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a70a9509-504a-4ff3-8dca-e7618f0b89fc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:40.474482 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 4634c1b1-c304-4ba1-8838-1ca98077fc34 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:40.533072 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Attempting to bind port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:14:40.533450 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Attempting to bind port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:14:40.533820 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Attempting to bind port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:40.549151 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 14, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:14:40.549536 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:40.549943 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.550349 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:14:40.550865 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Bound port: a8101963-8b0b-49ed-a2c5-db4a1a0c93a0, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:14:40.551206 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.576384 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03cc22c7-baee-4cf5-b61c-ba9bd92f1dea None None] Pushing event updated for resources: {'Port': ['ID=a8101963-8b0b-49ed-a2c5-db4a1a0c93a0,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:40.593857 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-03cc22c7-baee-4cf5-b61c-ba9bd92f1dea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:40.602004 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.604155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-112ecd97-0e50-4598-836f-c007d2f0cec6 None None] Provisioning for port b3466c6d-ebf3-44dd-9234-ecea275a28d0 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:40.606602 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.615563 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-112ecd97-0e50-4598-836f-c007d2f0cec6 None None] Provisioning complete for port b3466c6d-ebf3-44dd-9234-ecea275a28d0 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:40.615963 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-112ecd97-0e50-4598-836f-c007d2f0cec6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.639489 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a42f1907-3a8e-45a8-a98c-98dd9def9b07 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:40.696982 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 4634c1b1-c304-4ba1-8838-1ca98077fc34 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:40.696982 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.719752 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Pushing event updated for resources: {'Port': ['ID=b3466c6d-ebf3-44dd-9234-ecea275a28d0,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:40.721766 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] For port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:14:40.722094 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.728963 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:40.741474 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-112ecd97-0e50-4598-836f-c007d2f0cec6 None None] Port b3466c6d-ebf3-44dd-9234-ecea275a28d0 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:14:40.752111 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] For port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=a8101963-8b0b-49ed-a2c5-db4a1a0c93a0,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:14:40.759323 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:40.765348 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:40.863401 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Network 752d795b-2d24-4813-8699-de94831f729d is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:14:40.864425 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:14:40.909417 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Routers {'0791e9cb-453f-46b2-8069-4d3ba2947899'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:40.910074 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57982e1040>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['0791e9cb-453f-46b2-8069-4d3ba2947899'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:41.015495 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03cc22c7-baee-4cf5-b61c-ba9bd92f1dea None None] Pushing event updated for resources: {'Port': ['ID=a8101963-8b0b-49ed-a2c5-db4a1a0c93a0,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:41.018842 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-03cc22c7-baee-4cf5-b61c-ba9bd92f1dea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:41.067390 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Router 0791e9cb-453f-46b2-8069-4d3ba2947899 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:14:41.164327 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] Set router 0791e9cb-453f-46b2-8069-4d3ba2947899 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:41.240497 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-945c142a-931e-47b2-a0ec-6864cea13958 None None] Provisioning complete for port b3466c6d-ebf3-44dd-9234-ecea275a28d0 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:41.240875 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-945c142a-931e-47b2-a0ec-6864cea13958 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:41.255223 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:14:41.264105 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] 10.222.0.74 "PUT /v2.0/routers/0791e9cb-453f-46b2-8069-4d3ba2947899/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5068638
Jun 01 11:14:41.415517 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-945c142a-931e-47b2-a0ec-6864cea13958 None None] Port b3466c6d-ebf3-44dd-9234-ecea275a28d0 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:14:41.529623 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57982e1040>, [{'id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 4, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'gw_port': {'id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:dc:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'b3466c6d-ebf3-44dd-9234-ecea275a28d0', 'name': '', 'network_id': '752d795b-2d24-4813-8699-de94831f729d', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'mac_address': 'fa:16:3e:8f:b4:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_interface', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:39Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 2, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'subnets': [{'id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:41.533598 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c471621-ca43-4b37-85d2-271142797f23 None None] The sync data for ids ['0791e9cb-453f-46b2-8069-4d3ba2947899'] in dv-cinder-787764-3-iscsi is: [{'id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 4, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'gw_port': {'id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:dc:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'b3466c6d-ebf3-44dd-9234-ecea275a28d0', 'name': '', 'network_id': '752d795b-2d24-4813-8699-de94831f729d', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'mac_address': 'fa:16:3e:8f:b4:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_interface', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:39Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 2, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'subnets': [{'id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:14:41.833682 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36566) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:41.839369 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-351926286', 'description': 'tempest-secgroup-smoke-351926286 description', 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:41.846028 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:41.849883 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:security_group and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:41.852876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:41.863294 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:41.875752 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:41.897396 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:41.901343 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:security_group_rule and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:41.904895 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:41.910713 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:41.983802 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:41.987707 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:41.991378 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-57133fb8-dbc1-44e9-9576-9104f339aaba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:42.031618 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'SecurityGroup': ['ID=12440fc5-32f5-4005-bb76-cf9e245c04c3,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:42.034411 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.038308 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.2009139
Jun 01 11:14:42.038308 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:42.038583 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 36570) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:42.043835 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Request body: {'security_group_rule': {'security_group_id': '12440fc5-32f5-4005-bb76-cf9e245c04c3', 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:42.060036 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:42.065730 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:security_group_rule and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:42.068976 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:42.075105 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:42.095137 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.156207 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.159476 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.162532 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0d2cabc9-5749-4ae1-847d-3465e95d6ae6 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:42.186707 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=822b0e89-740a-4423-b9e3-3f0b063f7c5b,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:42.192723 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:42.199196 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.203528 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-dbfa2d80-2d8e-4092-b4fb-11d4a6f02437 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1616387
Jun 01 11:14:42.203929 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36580) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:42.209346 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Request body: {'security_group_rule': {'security_group_id': '12440fc5-32f5-4005-bb76-cf9e245c04c3', 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:42.215571 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:42.221449 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:security_group_rule and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:42.225286 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:42.232536 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:42.253984 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.325090 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.328819 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.330968 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:42.352800 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=700369dd-62aa-48fa-a566-e1b6537407f5,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:42.355465 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:42.362977 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.364180 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1592169
Jun 01 11:14:42.366801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36584) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:42.371875 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Request body: {'security_group_rule': {'security_group_id': '12440fc5-32f5-4005-bb76-cf9e245c04c3', 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:42.377982 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:42.381716 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:security_group_rule and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:42.384550 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:42.391102 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:42.406560 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.466671 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.470092 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.472010 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:42.493368 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7f7b88f0-b874-41df-b5a3-135004763989,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:42.495731 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:42.503239 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.504440 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-f473ee23-a27f-4350-a67b-f96e68353860 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1366944
Jun 01 11:14:42.507039 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36588) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:42.512247 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Request body: {'security_group_rule': {'security_group_id': '12440fc5-32f5-4005-bb76-cf9e245c04c3', 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:42.517708 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:42.521434 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:security_group_rule and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:42.524261 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:42.530387 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:42.546917 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.620838 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.632656 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.635002 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1edf8857-2b77-4311-b6e0-61454173b159 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:42.658266 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c04eecd9-d6ca-46f1-a9d8-252e7b3ba92d,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:42.663227 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:42.669655 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.671288 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-17df9512-e040-462f-bc8a-006cbd18316e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1632092
Jun 01 11:14:42.673830 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36592) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:42.679078 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Request body: {'security_group_rule': {'security_group_id': '12440fc5-32f5-4005-bb76-cf9e245c04c3', 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:42.685224 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:42.689515 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:security_group_rule and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:42.692837 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:42.699119 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:42.715381 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.securitygroups_db [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Project 7105d2f283044a3c9f1397f5e07b0bfe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 11:14:42.722466 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.791537 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.795302 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.797343 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:42.820628 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2350ff6b-9f12-4b2f-a797-92073303bccb,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:42.825780 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:42.830839 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.832113 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-70f2a6d1-02c7-4c8e-97cd-1084df6c711a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1572330
Jun 01 11:14:42.834801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36596) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:42.840046 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Request body: {'security_group_rule': {'security_group_id': '12440fc5-32f5-4005-bb76-cf9e245c04c3', 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:42.846055 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:14:42.850190 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:security_group_rule and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:14:42.853210 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:14:42.859269 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:14:42.870339 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.securitygroups_db [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Project 7105d2f283044a3c9f1397f5e07b0bfe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 11:14:42.877369 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.945947 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.949897 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.957091 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-535f002d-0f92-47d0-ae70-2595233abe6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:42.976851 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=af1c1b5b-6025-406a-a49c-c9ded445d4ad,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:42.979763 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:42.989491 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:42.990705 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-6b6a4c46-9114-4742-8dbe-6ee7c5069683 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1549592
Jun 01 11:14:44.490534 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:44.571401 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:44.576334 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:44.576711 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:44.670276 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Sync routers for ids ['0791e9cb-453f-46b2-8069-4d3ba2947899'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:14:44.681209 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Routers {'0791e9cb-453f-46b2-8069-4d3ba2947899'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:44.681850 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57983c3af0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['0791e9cb-453f-46b2-8069-4d3ba2947899'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:44.710227 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:44.727134 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=a8101963-8b0b-49ed-a2c5-db4a1a0c93a0,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:44.730967 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:44.733394 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:44.802155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=a8101963-8b0b-49ed-a2c5-db4a1a0c93a0,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:44.805199 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:44.873036 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Set router 0791e9cb-453f-46b2-8069-4d3ba2947899 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:45.179858 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57983c3af0>, [{'id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 4, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'gw_port': {'id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:dc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'b3466c6d-ebf3-44dd-9234-ecea275a28d0', 'name': '', 'network_id': '752d795b-2d24-4813-8699-de94831f729d', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'mac_address': 'fa:16:3e:8f:b4:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_interface', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:39Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 2, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'subnets': [{'id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:45.183614 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Checking router: 0791e9cb-453f-46b2-8069-4d3ba2947899 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:14:45.183955 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Updating router 0791e9cb-453f-46b2-8069-4d3ba2947899 port b3466c6d-ebf3-44dd-9234-ecea275a28d0 binding host dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:14:45.239346 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:45.593180 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Notify callbacks [] for port, precommit_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:45.605765 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.provisioning_blocks [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Transition to ACTIVE for port object b3466c6d-ebf3-44dd-9234-ecea275a28d0 will not be triggered until provisioned by entity L2. {{(pid=119243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:14:45.613355 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:45.621250 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:45.783833 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Pushing event updated for resources: {'Port': ['ID=b3466c6d-ebf3-44dd-9234-ecea275a28d0,revision_number=3']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:45.830916 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.831457 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.831931 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.832474 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.832884 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.833212 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.833529 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.833850 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.834192 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.834530 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.834887 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.835139 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:14:45.843056 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:45.888557 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Attempting to bind port b3466c6d-ebf3-44dd-9234-ecea275a28d0 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:14:45.888924 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Attempting to bind port b3466c6d-ebf3-44dd-9234-ecea275a28d0 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '809c0da7-01a9-42fc-9673-27dab824c772', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '752d795b-2d24-4813-8699-de94831f729d'}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:14:45.889284 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Attempting to bind port b3466c6d-ebf3-44dd-9234-ecea275a28d0 on network 752d795b-2d24-4813-8699-de94831f729d {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:14:45.894495 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 14, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:14:45.894867 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Checking segment: {'id': '809c0da7-01a9-42fc-9673-27dab824c772', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '752d795b-2d24-4813-8699-de94831f729d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:14:45.895259 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:45.895676 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Bound using segment: {'id': '809c0da7-01a9-42fc-9673-27dab824c772', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '752d795b-2d24-4813-8699-de94831f729d'} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:14:45.896141 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Bound port: b3466c6d-ebf3-44dd-9234-ecea275a28d0, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '809c0da7-01a9-42fc-9673-27dab824c772', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '752d795b-2d24-4813-8699-de94831f729d'}}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:14:45.896510 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:45.985625 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] For port b3466c6d-ebf3-44dd-9234-ecea275a28d0, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:14:45.988610 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] For port b3466c6d-ebf3-44dd-9234-ecea275a28d0, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=b3466c6d-ebf3-44dd-9234-ecea275a28d0,segment=NetworkSegment(809c0da7-01a9-42fc-9673-27dab824c772),segment_id=809c0da7-01a9-42fc-9673-27dab824c772)] {{(pid=119243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:14:45.992580 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:45.996646 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:46.072622 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Routers {'0791e9cb-453f-46b2-8069-4d3ba2947899'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:46.073255 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57983c3af0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['0791e9cb-453f-46b2-8069-4d3ba2947899'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:46.130647 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Pushing event updated for resources: {'Port': ['ID=b3466c6d-ebf3-44dd-9234-ecea275a28d0,revision_number=4']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:46.141396 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:46.263409 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] Set router 0791e9cb-453f-46b2-8069-4d3ba2947899 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:46.475786 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device b3466c6d-ebf3-44dd-9234-ecea275a28d0 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:46.545982 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port b3466c6d-ebf3-44dd-9234-ecea275a28d0 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:14:46.553612 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port b3466c6d-ebf3-44dd-9234-ecea275a28d0 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:46.553994 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:46.584404 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57983c3af0>, [{'id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 4, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'gw_port': {'id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:dc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'b3466c6d-ebf3-44dd-9234-ecea275a28d0', 'name': '', 'network_id': '752d795b-2d24-4813-8699-de94831f729d', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'mac_address': 'fa:16:3e:8f:b4:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_interface', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:39Z', 'updated_at': '2021-06-01T11:14:45Z', 'revision_number': 4, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'subnets': [{'id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:46.588640 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d51e02e-cec1-46dc-870e-0f56d3f21ddc None None] The sync data for ids ['0791e9cb-453f-46b2-8069-4d3ba2947899'] in dv-cinder-787764-3-iscsi is: [{'id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:40Z', 'revision_number': 4, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'gw_port': {'id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:dc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'b3466c6d-ebf3-44dd-9234-ecea275a28d0', 'name': '', 'network_id': '752d795b-2d24-4813-8699-de94831f729d', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'mac_address': 'fa:16:3e:8f:b4:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_interface', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:39Z', 'updated_at': '2021-06-01T11:14:45Z', 'revision_number': 4, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'subnets': [{'id': '3b5f5f5b-e070-408f-acb0-c059a55b7236', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:14:46.628351 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:46.709965 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:46.756977 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port b3466c6d-ebf3-44dd-9234-ecea275a28d0, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=b3466c6d-ebf3-44dd-9234-ecea275a28d0,segment=NetworkSegment(809c0da7-01a9-42fc-9673-27dab824c772),segment_id=809c0da7-01a9-42fc-9673-27dab824c772)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:46.763313 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:46.764559 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:46.851634 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:46.948308 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:46.948764 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:46.985598 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=b3466c6d-ebf3-44dd-9234-ecea275a28d0,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:46.995835 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:48.455998 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device b3466c6d-ebf3-44dd-9234-ecea275a28d0 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:14:48.526798 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port b3466c6d-ebf3-44dd-9234-ecea275a28d0 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:48.527178 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:51.146386 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35abc1a2-f602-435d-b7b8-db16d40c508b req-f47d264f-6e52-4064-937a-ef5bf841a61a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:51.148178 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-35abc1a2-f602-435d-b7b8-db16d40c508b req-f47d264f-6e52-4064-937a-ef5bf841a61a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 945 time: 0.0862424
Jun 01 11:14:51.192985 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-35abc1a2-f602-435d-b7b8-db16d40c508b req-00733a94-6092-4300-972a-252ff28d58c3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391951
Jun 01 11:14:51.531805 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-945b752a-ce9d-4921-8979-44624d529eb0 req-1438d1a6-a61c-4fcf-9543-37e02e71af34 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2039820528&fields=id&tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c HTTP/1.1" status: 200  len: 267 time: 0.0400364
Jun 01 11:14:51.699536 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-945b752a-ce9d-4921-8979-44624d529eb0 req-96b1cd85-1d8e-48bc-82fe-f75fe391227c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:51.701145 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-945b752a-ce9d-4921-8979-44624d529eb0 req-96b1cd85-1d8e-48bc-82fe-f75fe391227c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 984 time: 0.1640561
Jun 01 11:14:51.711649 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-945b752a-ce9d-4921-8979-44624d529eb0 req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Request body: {'port': {'security_groups': ['b439d80e-05e2-4757-aaae-a9fee5f6d9ee']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:14:51.827259 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-945b752a-ce9d-4921-8979-44624d529eb0 req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.067224 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-945b752a-ce9d-4921-8979-44624d529eb0 req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] For port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:52.094355 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-945b752a-ce9d-4921-8979-44624d529eb0 req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.099262 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-945b752a-ce9d-4921-8979-44624d529eb0 req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.105145 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c93cf295-92fa-4e80-a48d-a05514aa2821 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:52.110959 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:14:52.176233 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-945b752a-ce9d-4921-8979-44624d529eb0 req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:52.176891 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-945b752a-ce9d-4921-8979-44624d529eb0 req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.178320 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-945b752a-ce9d-4921-8979-44624d529eb0 req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "PUT /v2.0/ports/f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 942 time: 0.4711976
Jun 01 11:14:52.178845 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:52.181287 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd" -d '{"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:52.184378 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36742) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:52.214246 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event updated for resources: {'Port': ['ID=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,revision_number=7']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:52.218405 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:52.251565 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f5fb6b2c-8f14-4014-8d92-51afa42dde1e x-openstack-request-id: req-f5fb6b2c-8f14-4014-8d92-51afa42dde1e {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:52.251978 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:52.252279 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-f5fb6b2c-8f14-4014-8d92-51afa42dde1e {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:52.253410 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'status': 'completed', 'code': 200}
Jun 01 11:14:52.303357 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0b7abbce-da4d-4958-a758-a65ff284bb45 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.374317 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:14:52.448771 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-abca40b1-4821-4e79-a19f-2ed07a77f548 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:52.450170 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-abca40b1-4821-4e79-a19f-2ed07a77f548 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1098 time: 0.1679199
Jun 01 11:14:52.492360 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0b7abbce-da4d-4958-a758-a65ff284bb45 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.568564 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0b7abbce-da4d-4958-a758-a65ff284bb45 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.580076 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6ed516c4-aeb5-4215-b22a-1d2b033b011f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:52.598262 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-228ca241-0871-4b22-9453-4c9900e9bfca None None] Provisioning complete for port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:14:52.598644 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-228ca241-0871-4b22-9453-4c9900e9bfca None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.610676 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0b7abbce-da4d-4958-a758-a65ff284bb45 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.612948 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-0b7abbce-da4d-4958-a758-a65ff284bb45 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "DELETE /v2.0/security-groups/49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3 HTTP/1.1" status: 204  len: 168 time: 0.4267988
Jun 01 11:14:52.614412 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7abbce-da4d-4958-a758-a65ff284bb45 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=49b2b8c4-9b23-4ed7-81e0-dd8e59d075b3,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:52.616350 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36754) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:14:52.719642 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e5a486-2ad9-4c90-b191-557242430809 req-43eeada6-8a23-41dc-a104-5046662cee5a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:52.721498 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-54e5a486-2ad9-4c90-b191-557242430809 req-43eeada6-8a23-41dc-a104-5046662cee5a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 945 time: 0.2627916
Jun 01 11:14:52.722728 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-cb40e3cb-60d6-4382-96a5-9274cf0abb6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:52.724216 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-cb40e3cb-60d6-4382-96a5-9274cf0abb6c service neutron] 10.222.0.79 "GET /v2.0/networks?id=7356920a-571e-467c-9250-df782b9d8129 HTTP/1.1" status: 200  len: 915 time: 0.2082305
Jun 01 11:14:52.729437 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-5b93de20-6eff-4482-a5a4-e1772a625d4a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:52.729857 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0b7abbce-da4d-4958-a758-a65ff284bb45 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:52.859430 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-54e5a486-2ad9-4c90-b191-557242430809 req-fd3ffcbe-77db-458f-89d9-da004c498c6b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1303041
Jun 01 11:14:52.865528 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-1e4e0da4-d411-4e91-bbf2-443369781723 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 1001 time: 0.1206870
Jun 01 11:14:52.932900 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-26e1f642-4490-4e5a-b708-42a90c7b35d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:52.934340 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-26e1f642-4490-4e5a-b708-42a90c7b35d2 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=c5b015bf-9c86-450a-8cbd-8892adfddfb6 HTTP/1.1" status: 200  len: 853 time: 0.0609882
Jun 01 11:14:52.937761 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Deleting port de059772-4741-4e2f-b3a6-1be9653cdf74 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:14:52.938106 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:53.021291 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-cbbb107c-7ae6-45fb-9ad7-84216cf57d85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:53.023042 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-cbbb107c-7ae6-45fb-9ad7-84216cf57d85 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7356920a-571e-467c-9250-df782b9d8129&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0803781
Jun 01 11:14:53.059617 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:53.059967 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:53.159249 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-56b2ed71-2c7c-41e4-9b7a-34813b0dd663 service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1283448
Jun 01 11:14:53.184829 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Calling delete_port for de059772-4741-4e2f-b3a6-1be9653cdf74 owned by network:floatingip {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:14:53.325632 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:53.330241 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:53.342648 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-7a1563b8-6135-4510-a76e-06796558f0e3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:53.344083 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-7a1563b8-6135-4510-a76e-06796558f0e3 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 945 time: 0.1839950
Jun 01 11:14:53.374375 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event deleted for resources: {'Port': ['ID=de059772-4741-4e2f-b3a6-1be9653cdf74,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:53.405943 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ecacd571-944e-4aaa-817d-c4bc0b1e45cd req-3f9fed90-c792-488a-940a-454dfdd95a92 service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2117538
Jun 01 11:14:53.410214 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:53.467760 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks [] for floatingip, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:53.468101 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.l3_db [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Floating IP ed132e90-616d-4634-af5b-886d5c0141b2 disassociated (deleted). External IP: 172.27.3.129, port: f413cb23-a18e-4d8d-ab19-6cd2b065bc6f.
Jun 01 11:14:53.496348 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Deleting port 4907f837-a38b-48c2-bd58-8cc622deef39 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:14:53.496921 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:53.755331 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] For port 4907f837-a38b-48c2-bd58-8cc622deef39, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=4907f837-a38b-48c2-bd58-8cc622deef39,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:53.755725 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:53.844916 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:14:53.886343 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Calling delete_port for 4907f837-a38b-48c2-bd58-8cc622deef39 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:14:54.072075 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:54.077891 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:54.095315 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['7d85ff7b-1fb9-4870-919d-49ce962b290b', '121e5d5e-fe75-481f-9882-768f112ee1f8', '8188fbc7-28fc-4aa3-8f48-39221c1646fb', '4907f837-a38b-48c2-bd58-8cc622deef39'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:14:54.138711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Pushing event deleted for resources: {'Port': ['ID=4907f837-a38b-48c2-bd58-8cc622deef39,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:54.141745 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:14:54.143562 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:54.162143 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] Sync routers for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:14:54.168330 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:54.184918 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:54.185595 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57986faa60>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:54.220318 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421009f4-9dbd-483f-9b37-c48d25307937 req-36633824-17e6-4834-9b06-370a7685926f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:54.222010 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-421009f4-9dbd-483f-9b37-c48d25307937 req-36633824-17e6-4834-9b06-370a7685926f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=22c99fe2-9057-4bab-9952-4be03f70b5e1 HTTP/1.1" status: 200  len: 945 time: 0.2439053
Jun 01 11:14:54.237345 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "DELETE /v2.0/floatingips/ed132e90-616d-4634-af5b-886d5c0141b2 HTTP/1.1" status: 204  len: 168 time: 1.6161413
Jun 01 11:14:54.237345 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:54.238342 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e48b30fd-0e73-4b86-a95e-d20090e7e17c" -d '{"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:54.247081 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] No DVR routers for this DVR port 4907f837-a38b-48c2-bd58-8cc622deef39 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:14:54.253118 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:54.254872 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '22c99fe2-9057-4bab-9952-4be03f70b5e1', 'name': 'network-vif-deleted', 'tag': '4907f837-a38b-48c2-bd58-8cc622deef39'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:54.257477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78c00150-3158-423f-91ba-2b4fff72d591" -d '{"events": [{"server_uuid": "22c99fe2-9057-4bab-9952-4be03f70b5e1", "name": "network-vif-deleted", "tag": "4907f837-a38b-48c2-bd58-8cc622deef39"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:54.287884 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9e5b7f06-e228-42dc-af1e-903486aba00f req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "DELETE /v2.0/ports/4907f837-a38b-48c2-bd58-8cc622deef39 HTTP/1.1" status: 204  len: 173 time: 0.9348037
Jun 01 11:14:54.293925 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-421009f4-9dbd-483f-9b37-c48d25307937 req-9a43676b-a3e6-4505-b2ae-f8f3edceb2e0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0661125
Jun 01 11:14:54.363997 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65a2edbe-d44e-404e-b176-3bfb93a4172c x-openstack-request-id: req-65a2edbe-d44e-404e-b176-3bfb93a4172c {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:54.364391 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:54.364669 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-65a2edbe-d44e-404e-b176-3bfb93a4172c {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:54.365104 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'status': 'completed', 'code': 200}
Jun 01 11:14:54.457499 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-afcd5ce4-e7ae-45a9-abe3-86d67e806f50 x-openstack-request-id: req-afcd5ce4-e7ae-45a9-abe3-86d67e806f50 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:54.458096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "22c99fe2-9057-4bab-9952-4be03f70b5e1", "name": "network-vif-deleted", "tag": "4907f837-a38b-48c2-bd58-8cc622deef39", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:54.458096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-afcd5ce4-e7ae-45a9-abe3-86d67e806f50 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:54.458514 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '22c99fe2-9057-4bab-9952-4be03f70b5e1', 'name': 'network-vif-deleted', 'tag': '4907f837-a38b-48c2-bd58-8cc622deef39', 'status': 'completed', 'code': 200}
Jun 01 11:14:54.508018 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-13220c26-50ed-4d30-8c23-b6938aa0fe7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:54.509731 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-13220c26-50ed-4d30-8c23-b6938aa0fe7e service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 1098 time: 0.1095896
Jun 01 11:14:54.516610 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:54.668962 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-5dbe9bf2-aaf7-4de8-bafd-70fb5fa99019 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:54.671328 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-5dbe9bf2-aaf7-4de8-bafd-70fb5fa99019 service neutron] 10.222.0.79 "GET /v2.0/networks?id=7356920a-571e-467c-9250-df782b9d8129 HTTP/1.1" status: 200  len: 915 time: 0.1505897
Jun 01 11:14:54.762866 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-72b6abaf-9b04-4c58-885e-8f37116a1990 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 200  len: 217 time: 0.0778546
Jun 01 11:14:54.890214 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-9258cd67-e97e-4f25-8ce4-ec12dfa0d7d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:54.891846 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-9258cd67-e97e-4f25-8ce4-ec12dfa0d7d4 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=c5b015bf-9c86-450a-8cbd-8892adfddfb6 HTTP/1.1" status: 200  len: 853 time: 0.1204429
Jun 01 11:14:55.021184 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-8d311edb-9dbf-4451-923e-17fb592d3396 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:55.025667 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-8d311edb-9dbf-4451-923e-17fb592d3396 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=7356920a-571e-467c-9250-df782b9d8129&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1230564
Jun 01 11:14:55.044696 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57986faa60>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:42Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'e95624ae-5876-4f15-ad18-6a0cf9360081', 'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'mac_address': 'fa:16:3e:79:34:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_interface', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:41Z', 'updated_at': '2021-06-01T11:11:48Z', 'revision_number': 5, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'subnets': [{'id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:55.059894 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] Checking router: a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:14:55.088085 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:14:55.088724 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57986faa60>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:55.177067 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-4cd92d92-a46b-46bd-8cb1-08fa48a934ef service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1397057
Jun 01 11:14:55.303947 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b482fe10-841f-46fe-be19-75287f3e901e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:55.321979 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e48b30fd-0e73-4b86-a95e-d20090e7e17c req-0d72709d-ae39-4977-bdc1-5e7284d43dd8 service neutron] 10.222.0.79 "GET /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1361687
Jun 01 11:14:55.332872 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:14:55.380880 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:55.662284 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57986faa60>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:42Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'e95624ae-5876-4f15-ad18-6a0cf9360081', 'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'mac_address': 'fa:16:3e:79:34:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_interface', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:41Z', 'updated_at': '2021-06-01T11:11:48Z', 'revision_number': 5, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'subnets': [{'id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:14:55.666205 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32ada244-65f5-4ee0-914c-6e843195e2ce None None] The sync data for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi is: [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:11:42Z', 'revision_number': 4, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'e95624ae-5876-4f15-ad18-6a0cf9360081', 'name': '', 'network_id': '7356920a-571e-467c-9250-df782b9d8129', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'mac_address': 'fa:16:3e:79:34:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_interface', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:41Z', 'updated_at': '2021-06-01T11:11:48Z', 'revision_number': 5, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'subnets': [{'id': 'c5b015bf-9c86-450a-8cbd-8892adfddfb6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:14:55.898262 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed8787df-1d05-4a60-8431-ef78b05d6780 None None] New status for floating IP ed132e90-616d-4634-af5b-886d5c0141b2: DOWN {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:14:56.398147 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:57.018813 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed72bff-46c6-476c-9964-c360eae49bf5 req-5759805b-9a94-4be6-87de-b608e409c5de tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:57.019519 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-eed72bff-46c6-476c-9964-c360eae49bf5 req-5759805b-9a94-4be6-87de-b608e409c5de tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Synchronizing usage tracker for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:14:57.037287 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-eed72bff-46c6-476c-9964-c360eae49bf5 req-5759805b-9a94-4be6-87de-b608e409c5de tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Unset dirty status for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:14:57.038711 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eed72bff-46c6-476c-9964-c360eae49bf5 req-5759805b-9a94-4be6-87de-b608e409c5de tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 945 time: 0.1044364
Jun 01 11:14:57.085726 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-eed72bff-46c6-476c-9964-c360eae49bf5 req-b3244a1a-04be-4792-af15-e056f401a3a9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409853
Jun 01 11:14:57.648287 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6210a86-4dc9-4851-b18d-c5e4e839277e req-5b095f42-ba21-4da8-9fd4-722ef27fd24c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:57.649730 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b6210a86-4dc9-4851-b18d-c5e4e839277e req-5b095f42-ba21-4da8-9fd4-722ef27fd24c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.0796585
Jun 01 11:14:57.697789 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b6210a86-4dc9-4851-b18d-c5e4e839277e req-cc5304e8-709d-4e40-90ac-76dc39d78a09 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418663
Jun 01 11:14:57.741315 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:58.196931 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 4907f837-a38b-48c2-bd58-8cc622deef39 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:14:58.235331 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 4907f837-a38b-48c2-bd58-8cc622deef39 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:14:58.235717 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 4907f837-a38b-48c2-bd58-8cc622deef39 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:14:58.273342 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b657d24-3e2a-4164-b9a4-43d1dd5064ad req-cc01111e-1dbe-4154-af53-7cd85e9915ca tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:58.274902 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7b657d24-3e2a-4164-b9a4-43d1dd5064ad req-cc01111e-1dbe-4154-af53-7cd85e9915ca tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 945 time: 0.0814750
Jun 01 11:14:58.321847 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7b657d24-3e2a-4164-b9a4-43d1dd5064ad req-18d28c07-3ed0-4fac-a8c9-fb7f2c5ff78b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404739
Jun 01 11:14:58.999328 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62729485-511c-4b89-bfc6-49da580430be req-ff1146b7-2fb9-4dee-b57a-f7a013b5aef9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:59.000768 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-62729485-511c-4b89-bfc6-49da580430be req-ff1146b7-2fb9-4dee-b57a-f7a013b5aef9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 945 time: 0.2221923
Jun 01 11:14:59.008697 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a547a3-508f-4e8d-836b-2f5c0597e2ea req-8133847e-0480-4edc-863d-362eee2d1c09 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:59.010018 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d9a547a3-508f-4e8d-836b-2f5c0597e2ea req-8133847e-0480-4edc-863d-362eee2d1c09 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.2010286
Jun 01 11:14:59.139780 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d9a547a3-508f-4e8d-836b-2f5c0597e2ea req-527b5904-4b23-40e4-baa6-9b6167f22a49 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1003277
Jun 01 11:14:59.173448 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-62729485-511c-4b89-bfc6-49da580430be req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Deleting port 8188fbc7-28fc-4aa3-8f48-39221c1646fb {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:14:59.173823 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-62729485-511c-4b89-bfc6-49da580430be req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:59.309606 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-62729485-511c-4b89-bfc6-49da580430be req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] For port 8188fbc7-28fc-4aa3-8f48-39221c1646fb, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=8188fbc7-28fc-4aa3-8f48-39221c1646fb,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:14:59.310314 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-62729485-511c-4b89-bfc6-49da580430be req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:59.437433 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-62729485-511c-4b89-bfc6-49da580430be req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Calling delete_port for 8188fbc7-28fc-4aa3-8f48-39221c1646fb owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:14:59.541995 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c71da0-ca23-44ef-a27f-97c1e33cf601 req-d7832b7b-ee50-498a-9111-333bffe07ca7 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:59.543883 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-43c71da0-ca23-44ef-a27f-97c1e33cf601 req-d7832b7b-ee50-498a-9111-333bffe07ca7 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=30b72546-8e51-4187-b117-40d55cc14dff HTTP/1.1" status: 200  len: 945 time: 0.1145020
Jun 01 11:14:59.630384 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-43c71da0-ca23-44ef-a27f-97c1e33cf601 req-f2bd6820-35f8-4917-b127-065a2b56dd98 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0749321
Jun 01 11:14:59.657781 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-62729485-511c-4b89-bfc6-49da580430be req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:59.663064 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:14:59.673637 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['7d85ff7b-1fb9-4870-919d-49ce962b290b', '121e5d5e-fe75-481f-9882-768f112ee1f8', '8188fbc7-28fc-4aa3-8f48-39221c1646fb'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:14:59.745791 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Pushing event deleted for resources: {'Port': ['ID=8188fbc7-28fc-4aa3-8f48-39221c1646fb,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:14:59.754076 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:14:59.840749 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-62729485-511c-4b89-bfc6-49da580430be req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] No DVR routers for this DVR port 8188fbc7-28fc-4aa3-8f48-39221c1646fb on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:14:59.844765 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-62729485-511c-4b89-bfc6-49da580430be req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:14:59.847242 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '30b72546-8e51-4187-b117-40d55cc14dff', 'name': 'network-vif-deleted', 'tag': '8188fbc7-28fc-4aa3-8f48-39221c1646fb'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:14:59.849536 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9659dd11-1d6c-4081-8a67-581b84666e2c" -d '{"events": [{"server_uuid": "30b72546-8e51-4187-b117-40d55cc14dff", "name": "network-vif-deleted", "tag": "8188fbc7-28fc-4aa3-8f48-39221c1646fb"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:14:59.867535 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-62729485-511c-4b89-bfc6-49da580430be req-5bd3a407-d418-4fb4-b790-b00b17c5b55b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "DELETE /v2.0/ports/8188fbc7-28fc-4aa3-8f48-39221c1646fb HTTP/1.1" status: 204  len: 173 time: 0.8563943
Jun 01 11:14:59.880353 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-ec67dbaa-c415-4b9f-89f2-a1afae8be29c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:14:59.881900 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-ec67dbaa-c415-4b9f-89f2-a1afae8be29c tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.79 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.1793587
Jun 01 11:14:59.922167 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:14:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9b87819-cecc-4dce-ae60-421069956687 x-openstack-request-id: req-d9b87819-cecc-4dce-ae60-421069956687 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:14:59.922402 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "30b72546-8e51-4187-b117-40d55cc14dff", "name": "network-vif-deleted", "tag": "8188fbc7-28fc-4aa3-8f48-39221c1646fb", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:14:59.922663 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-d9b87819-cecc-4dce-ae60-421069956687 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:14:59.923087 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '30b72546-8e51-4187-b117-40d55cc14dff', 'name': 'network-vif-deleted', 'tag': '8188fbc7-28fc-4aa3-8f48-39221c1646fb', 'status': 'completed', 'code': 200}
Jun 01 11:15:00.027764 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Deleting port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:00.028101 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:00.160609 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] For port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:00.160962 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:00.283269 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Calling delete_port for f413cb23-a18e-4d8d-ab19-6cd2b065bc6f owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:00.386909 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e230cc73-341b-4f0e-b6f2-9dbbe306ac56 req-d1b3604d-04cf-45de-9790-84427732a5de tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:00.388386 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e230cc73-341b-4f0e-b6f2-9dbbe306ac56 req-d1b3604d-04cf-45de-9790-84427732a5de tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/ports?device_id=f73c65b3-f552-447f-ba74-cc7a82698e40 HTTP/1.1" status: 200  len: 945 time: 0.1124136
Jun 01 11:15:00.473590 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e230cc73-341b-4f0e-b6f2-9dbbe306ac56 req-aa1e46b9-05a7-41fb-b73f-df3da3a4d532 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.74 "GET /v2.0/security-groups?id=b439d80e-05e2-4757-aaae-a9fee5f6d9ee&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0778735
Jun 01 11:15:00.516848 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:00.522736 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-472428bb-52b6-41d9-b45a-e84c4d0bff92 tempest-ServerRescueNegativeTestJSON-1531974975 tempest-ServerRescueNegativeTestJSON-1531974975-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:00.532050 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:15:00.573180 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Pushing event deleted for resources: {'Port': ['ID=f413cb23-a18e-4d8d-ab19-6cd2b065bc6f,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:00.576951 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:00.743305 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] No DVR routers for this DVR port f413cb23-a18e-4d8d-ab19-6cd2b065bc6f on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:15:00.745736 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:00.755538 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b477bb79-b26e-491f-9e6d-fdcdc298bf55 req-91237cf1-1fc4-44d5-9b02-99ef36e29722 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] 10.222.0.79 "DELETE /v2.0/ports/f413cb23-a18e-4d8d-ab19-6cd2b065bc6f HTTP/1.1" status: 204  len: 173 time: 0.8667834
Jun 01 11:15:00.809423 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:15:01.094648 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa97f23-8056-4c6f-83bf-ee6fa1d7a37f req-5ef856c9-8c0e-415f-855d-5b0991aa4ba0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:01.095329 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1aa97f23-8056-4c6f-83bf-ee6fa1d7a37f req-5ef856c9-8c0e-415f-855d-5b0991aa4ba0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Synchronizing usage tracker for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:15:01.110359 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1aa97f23-8056-4c6f-83bf-ee6fa1d7a37f req-5ef856c9-8c0e-415f-855d-5b0991aa4ba0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Unset dirty status for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:15:01.111561 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1aa97f23-8056-4c6f-83bf-ee6fa1d7a37f req-5ef856c9-8c0e-415f-855d-5b0991aa4ba0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 946 time: 0.0967705
Jun 01 11:15:01.156358 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1aa97f23-8056-4c6f-83bf-ee6fa1d7a37f req-bc44d5ba-2902-466a-87f9-229572b5591b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389256
Jun 01 11:15:01.923994 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'name': 'network-vif-deleted', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:15:01.926320 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-594d8d8b-37d5-463a-9fcc-2a778f5ab724" -d '{"events": [{"server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "name": "network-vif-deleted", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:15:01.971401 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:15:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5fae481-ac5e-4ffa-8e2e-d7614fad6cb0 x-openstack-request-id: req-b5fae481-ac5e-4ffa-8e2e-d7614fad6cb0 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:15:01.971854 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f73c65b3-f552-447f-ba74-cc7a82698e40", "name": "network-vif-deleted", "tag": "f413cb23-a18e-4d8d-ab19-6cd2b065bc6f", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:15:01.972034 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-b5fae481-ac5e-4ffa-8e2e-d7614fad6cb0 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:15:01.972603 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f73c65b3-f552-447f-ba74-cc7a82698e40', 'name': 'network-vif-deleted', 'tag': 'f413cb23-a18e-4d8d-ab19-6cd2b065bc6f', 'status': 'completed', 'code': 200}
Jun 01 11:15:02.241966 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36926) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:02.350785 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd56c570-d64f-41cc-a22f-e2d9cf709166 req-785ba9b3-c6de-4585-a35a-eacafb5294dd tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:02.352180 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd56c570-d64f-41cc-a22f-e2d9cf709166 req-785ba9b3-c6de-4585-a35a-eacafb5294dd tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 946 time: 0.0830266
Jun 01 11:15:02.401495 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd56c570-d64f-41cc-a22f-e2d9cf709166 req-c463979c-3df3-4dbb-af99-a64d9211f57c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433979
Jun 01 11:15:02.789579 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-926124'] for router_interface, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:02.822189 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-7f9e2ffa-b9ea-4371-b3bd-42cb5d455ca0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:02.823630 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-7f9e2ffa-b9ea-4371-b3bd-42cb5d455ca0 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 946 time: 0.0822089
Jun 01 11:15:02.974047 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Deleting port 121e5d5e-fe75-481f-9882-768f112ee1f8 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:02.974701 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:03.106776 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] For port 121e5d5e-fe75-481f-9882-768f112ee1f8, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=121e5d5e-fe75-481f-9882-768f112ee1f8,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:03.107162 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:03.208727 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Deleting port e95624ae-5876-4f15-ad18-6a0cf9360081 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:03.209067 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:03.231467 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Calling delete_port for 121e5d5e-fe75-481f-9882-768f112ee1f8 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:03.334212 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] For port e95624ae-5876-4f15-ad18-6a0cf9360081, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=e95624ae-5876-4f15-ad18-6a0cf9360081,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:03.334801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:03.344557 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:03.350282 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d53de1ea-5c9b-49d3-a9d3-5354782c1212 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:03.356145 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['7d85ff7b-1fb9-4870-919d-49ce962b290b', '121e5d5e-fe75-481f-9882-768f112ee1f8'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:15:03.394316 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Pushing event deleted for resources: {'Port': ['ID=121e5d5e-fe75-481f-9882-768f112ee1f8,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:03.398317 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:03.476161 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Calling delete_port for e95624ae-5876-4f15-ad18-6a0cf9360081 owned by network:router_interface {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:03.480698 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] No DVR routers for this DVR port 121e5d5e-fe75-481f-9882-768f112ee1f8 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:15:03.483379 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:03.499748 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f8e2f26c-2c3c-4db4-a563-d4686fe8421f req-bc1da7fa-0226-44e3-bddf-4efd0744a86a tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "DELETE /v2.0/ports/121e5d5e-fe75-481f-9882-768f112ee1f8 HTTP/1.1" status: 204  len: 173 time: 0.6611111
Jun 01 11:15:03.592842 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-006e7f95-86bb-417a-aa01-84b5493bacf4 req-8f1e42f0-bc0a-428e-955d-1503592803b5 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Synchronizing usage tracker for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:15:03.621706 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-006e7f95-86bb-417a-aa01-84b5493bacf4 req-8f1e42f0-bc0a-428e-955d-1503592803b5 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Unset dirty status for tenant:a83ba65361364d0fad1aa55a0f8cb7cf on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:15:03.623682 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-006e7f95-86bb-417a-aa01-84b5493bacf4 req-8f1e42f0-bc0a-428e-955d-1503592803b5 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=02d71b67-8490-4a0f-97e2-e1f3cd31cc8d HTTP/1.1" status: 200  len: 210 time: 0.0797594
Jun 01 11:15:03.801305 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-f86e4e5e-e556-42d7-95af-c93adf31bdec tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Synchronizing usage tracker for tenant:7105d2f283044a3c9f1397f5e07b0bfe on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:15:03.818255 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-f86e4e5e-e556-42d7-95af-c93adf31bdec tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Unset dirty status for tenant:7105d2f283044a3c9f1397f5e07b0bfe on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:15:03.819436 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-f86e4e5e-e556-42d7-95af-c93adf31bdec tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-351926286&fields=id&tenant_id=7105d2f283044a3c9f1397f5e07b0bfe HTTP/1.1" status: 200  len: 267 time: 0.0575674
Jun 01 11:15:03.924163 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:03.930584 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-79373f7f-c1c9-4bfd-bb5f-be2311ad6cd1 tempest-VolumesActionsTest-1059599354 tempest-VolumesActionsTest-1059599354-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:03.974614 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02d71b67-8490-4a0f-97e2-e1f3cd31cc8d', 'name': 'network-vif-deleted', 'tag': '121e5d5e-fe75-481f-9882-768f112ee1f8'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:15:03.977917 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2279e3e3-c261-4589-a3ce-bcbf428032d1" -d '{"events": [{"server_uuid": "02d71b67-8490-4a0f-97e2-e1f3cd31cc8d", "name": "network-vif-deleted", "tag": "121e5d5e-fe75-481f-9882-768f112ee1f8"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:15:03.978074 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Pushing event deleted for resources: {'Port': ['ID=e95624ae-5876-4f15-ad18-6a0cf9360081,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:03.988856 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-e768eac0-a089-46aa-8509-645b502f4492 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:03.989691 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-e768eac0-a089-46aa-8509-645b502f4492 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Synchronizing usage tracker for tenant:7105d2f283044a3c9f1397f5e07b0bfe on resource:network {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:15:04.016050 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-e768eac0-a089-46aa-8509-645b502f4492 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Unset dirty status for tenant:7105d2f283044a3c9f1397f5e07b0bfe on resource:network {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:15:04.017442 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-e768eac0-a089-46aa-8509-645b502f4492 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/networks?id=a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 200  len: 809 time: 0.1911962
Jun 01 11:15:04.025486 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.026055 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.026521 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.026896 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.027259 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.027632 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.028000 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.028355 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.028711 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.029062 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.029458 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.029811 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:04.053120 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-179cdd5d-ada9-4e3a-8ca6-2912257f771f tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/quotas/7105d2f283044a3c9f1397f5e07b0bfe HTTP/1.1" status: 200  len: 375 time: 0.0232210
Jun 01 11:15:04.060440 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:04.096396 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:15:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6e0d2454-bdf0-4456-8264-89cbfb1ca119 x-openstack-request-id: req-6e0d2454-bdf0-4456-8264-89cbfb1ca119 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:15:04.097031 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02d71b67-8490-4a0f-97e2-e1f3cd31cc8d", "name": "network-vif-deleted", "tag": "121e5d5e-fe75-481f-9882-768f112ee1f8", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:15:04.097349 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-6e0d2454-bdf0-4456-8264-89cbfb1ca119 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:15:04.097906 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02d71b67-8490-4a0f-97e2-e1f3cd31cc8d', 'name': 'network-vif-deleted', 'tag': '121e5d5e-fe75-481f-9882-768f112ee1f8', 'status': 'completed', 'code': 200}
Jun 01 11:15:04.165106 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-f5cbcc83-fa0f-4b11-a3a6-ebd5fa58e4f9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1108356
Jun 01 11:15:04.214276 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device f413cb23-a18e-4d8d-ab19-6cd2b065bc6f no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:04.267511 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: f413cb23-a18e-4d8d-ab19-6cd2b065bc6f {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:04.267782 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device f413cb23-a18e-4d8d-ab19-6cd2b065bc6f not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:04.268389 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 8188fbc7-28fc-4aa3-8f48-39221c1646fb no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:04.305608 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 8188fbc7-28fc-4aa3-8f48-39221c1646fb {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:04.306287 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 8188fbc7-28fc-4aa3-8f48-39221c1646fb not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:04.317984 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-776947', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-646716'] for router_interface, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:04.449023 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-072d4241-d434-49ed-b579-6114e1233664 service neutron] 10.222.0.74 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2654359
Jun 01 11:15:04.583891 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-2d83e11d-e4c1-4693-be4b-817701986b3d service neutron] 10.222.0.74 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1284599
Jun 01 11:15:04.687100 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:15:04.885775 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:15:04.898623 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] Sync routers for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:15:04.901936 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] 10.222.0.74 "PUT /v2.0/routers/a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6584556
Jun 01 11:15:04.904296 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36964) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:04.913878 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:15:04.915234 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798227430>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:05.106051 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks [] for router, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:05.140208 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:15:05.215955 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e318d3fd-77ad-4c28-bb10-4e681d79c83c req-30eab426-9311-48c9-acf3-2468475a46c9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 210 time: 0.1977072
Jun 01 11:15:05.430493 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:05.500971 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798227430>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:15:03Z', 'revision_number': 5, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port': {'id': 'f8b28fb3-0268-438a-bb44-551f800a3a7b', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:75:b5:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 394, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:37Z', 'updated_at': '2021-06-01T11:11:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:05.505781 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] Checking router: a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:15:05.506353 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Deleting port f8b28fb3-0268-438a-bb44-551f800a3a7b {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:05.506865 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:05.514893 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] Routers {'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:15:05.515578 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798227430>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:05.639981 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] For port f8b28fb3-0268-438a-bb44-551f800a3a7b, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f8b28fb3-0268-438a-bb44-551f800a3a7b,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:05.640330 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:05.671354 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] Set router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 gateway port host: None {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:15:05.775088 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Calling delete_port for f8b28fb3-0268-438a-bb44-551f800a3a7b owned by network:router_gateway {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:05.779133 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798227430>, [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:15:05Z', 'revision_number': 6, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port_host': None}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:05.783639 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a64d0ca-ee5e-41e2-be01-c8d089bdb3ca None None] The sync data for ids ['a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03'] in dv-cinder-787764-3-iscsi is: [{'id': 'a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03', 'name': 'tempest-TestMinimumBasicScenario-908262529-router', 'tenant_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:36Z', 'updated_at': '2021-06-01T11:15:05Z', 'revision_number': 6, 'project_id': '5c3d0a0f97d246d5a7afac5ec8c4d43c', 'gw_port_host': None}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:15:05.916022 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:05.919696 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-75619b76-55c4-4659-9366-1a2de885b2e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:05.962410 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Pushing event deleted for resources: {'Port': ['ID=f8b28fb3-0268-438a-bb44-551f800a3a7b,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:05.965580 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:06.057270 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-645297'] for router_gateway, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:06.278948 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-643132', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4050'] for router, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:06.281386 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:06.311124 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-643584'] for router, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:06.312748 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Fanout notify agent at l3_agent the message router_deleted on router a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 {{(pid=119240) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 11:15:06.335876 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:06.339711 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] 10.222.0.74 "DELETE /v2.0/routers/a9da92a4-d0ba-4a98-b26e-16f3fb8f7b03 HTTP/1.1" status: 204  len: 168 time: 1.4315996
Jun 01 11:15:06.340864 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36992) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:06.412797 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] Deleting subnet c5b015bf-9c86-450a-8cbd-8892adfddfb6 {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:15:06.415967 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:06.470874 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10700501'] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:06.494835 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ab716d2c-c31d-4534-a9e7-209e875d09c7 req-8a219d86-4ea0-404f-adb5-366216fb43a9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 210 time: 0.0487530
Jun 01 11:15:06.503203 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-975ede79-e48e-4544-a088-9e6cc0f0bc6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:06.504851 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-975ede79-e48e-4544-a088-9e6cc0f0bc6d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.79 "GET /v2.0/networks?id=a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 200  len: 809 time: 0.3505237
Jun 01 11:15:06.551376 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0813b1ab-de53-42d5-a7af-e2005803b9b3 req-0ab1b6cc-3ae4-43d2-8ccf-a322d471c106 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:06.558706 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0813b1ab-de53-42d5-a7af-e2005803b9b3 req-0ab1b6cc-3ae4-43d2-8ccf-a322d471c106 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 946 time: 0.2260244
Jun 01 11:15:06.608034 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:06.619963 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-4794c71e-97b4-40de-a694-96005d96f306 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7105d2f283044a3c9f1397f5e07b0bfe HTTP/1.1" status: 200  len: 379 time: 0.0932634
Jun 01 11:15:06.624504 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0813b1ab-de53-42d5-a7af-e2005803b9b3 req-06d385ed-899d-48aa-a3f7-e8c92e66a916 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0649390
Jun 01 11:15:06.629031 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Request body: {'port': {'device_id': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'admin_state_up': True, 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'security_groups': ['12440fc5-32f5-4005-bb76-cf9e245c04c3']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:15:06.735436 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device e95624ae-5876-4f15-ad18-6a0cf9360081 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:06.770822 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: e95624ae-5876-4f15-ad18-6a0cf9360081 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:06.771177 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device e95624ae-5876-4f15-ad18-6a0cf9360081 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:06.771826 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f8b28fb3-0268-438a-bb44-551f800a3a7b no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:06.783792 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:06.787832 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:port and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:06.791779 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for port was recalculated. Used quota:2. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:06.800484 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:06.811824 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Made reservation on behalf of 7105d2f283044a3c9f1397f5e07b0bfe for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:15:06.813693 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: f8b28fb3-0268-438a-bb44-551f800a3a7b {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:06.814061 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f8b28fb3-0268-438a-bb44-551f800a3a7b not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:06.815943 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:06.996433 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Allocated IP 172.20.0.14 (a30966a5-dc46-445f-8d4a-d8da7c97fafd/f490a491-e776-4472-a23c-46b7b609b438/c9d83745-527c-4d1e-b61f-a188ad54fae2) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:15:07.007519 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10700437', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-11313305'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.017508 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:07.050379 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.053710 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3caaab59-38ae-469b-85a6-f59b72a2ebbe None None] Network 7356920a-571e-467c-9250-df782b9d8129 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:15:07.057508 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c5b015bf-9c86-450a-8cbd-8892adfddfb6,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:07.064592 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:07.066372 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] 10.222.0.74 "DELETE /v2.0/subnets/c5b015bf-9c86-450a-8cbd-8892adfddfb6 HTTP/1.1" status: 204  len: 168 time: 0.7244275
Jun 01 11:15:07.076152 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 36998) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:07.196377 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.234354 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.250989 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Transition to ACTIVE for port object c9d83745-527c-4d1e-b61f-a188ad54fae2 will not be triggered until provisioned by entity DHCP. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:15:07.279742 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.290402 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:07.291090 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Deleting port c1678ffd-eeeb-49dd-802f-c62185c0fb7e {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:07.291442 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.360236 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Network a30966a5-dc46-445f-8d4a-d8da7c97fafd is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:15:07.363558 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:15:07.368085 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:15:07.390990 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] DHCP port deletion for 7356920a-571e-467c-9250-df782b9d8129 request from dv-cinder-787764-3-iscsi {{(pid=119242) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 11:15:07.403751 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] For port c1678ffd-eeeb-49dd-802f-c62185c0fb7e, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=c1678ffd-eeeb-49dd-802f-c62185c0fb7e,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:07.405167 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.410644 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'Port': ['ID=c9d83745-527c-4d1e-b61f-a188ad54fae2,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:07.418894 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:07.445575 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:07.446564 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.474257 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Deleting port c1678ffd-eeeb-49dd-802f-c62185c0fb7e {{(pid=119242) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:07.475031 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.479191 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-6161b6b5-7bf2-4177-979a-85cf0d5183ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8536441
Jun 01 11:15:07.501674 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Request body: {'port': {'device_id': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:15:07.579915 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Calling delete_port for c1678ffd-eeeb-49dd-802f-c62185c0fb7e owned by network:dhcp {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:07.602721 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] For port c1678ffd-eeeb-49dd-802f-c62185c0fb7e, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=c1678ffd-eeeb-49dd-802f-c62185c0fb7e,segment=NetworkSegment(ecc23ea4-0a3f-4193-b594-468b9b7873c9),segment_id=ecc23ea4-0a3f-4193-b594-468b9b7873c9)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:07.603398 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.650619 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.657585 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6e1bac13-3a7d-4723-9e47-2dd7d76ba60a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:07.670868 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.723952 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Pushing event deleted for resources: {'Port': ['ID=c1678ffd-eeeb-49dd-802f-c62185c0fb7e,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:07.727148 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:07.728023 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] No DVR routers for this DVR port c1678ffd-eeeb-49dd-802f-c62185c0fb7e on host dv-cinder-787764-3-iscsi {{(pid=119240) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:15:07.749235 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Calling delete_port for c1678ffd-eeeb-49dd-802f-c62185c0fb7e owned by network:dhcp {{(pid=119242) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:07.762916 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-84750002-b1b5-4140-acdc-505d5fb7fa7e None None] Provisioning for port c9d83745-527c-4d1e-b61f-a188ad54fae2 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:15:07.771163 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-84750002-b1b5-4140-acdc-505d5fb7fa7e None None] Provisioning complete for port c9d83745-527c-4d1e-b61f-a188ad54fae2 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:15:07.771777 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-84750002-b1b5-4140-acdc-505d5fb7fa7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.850726 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.865896 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f5798059070>,) {'filters': {'network_id': ['7356920a-571e-467c-9250-df782b9d8129']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:07.879679 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f5798059070>, 'ecc23ea4-0a3f-4193-b594-468b9b7873c9') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:07.880037 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f5798059070>, 'ecc23ea4-0a3f-4193-b594-468b9b7873c9') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:07.894170 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.908678 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-84750002-b1b5-4140-acdc-505d5fb7fa7e None None] Port c9d83745-527c-4d1e-b61f-a188ad54fae2 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:15:07.917487 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.924120 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Releasing vlan 680 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:15:07.924621 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:15:07.939325 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:15:07.947846 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676'] for port, after_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:07.957651 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-c7ec9ea8-7dd7-4e93-8fde-2e3062e76779 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:07.998686 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] No DVR routers for this DVR port c1678ffd-eeeb-49dd-802f-c62185c0fb7e on host dv-cinder-787764-3-iscsi {{(pid=119242) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:15:08.006349 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Pushing event deleted for resources: {'Port': ['ID=c1678ffd-eeeb-49dd-802f-c62185c0fb7e,revision_number=None']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:08.016517 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.016930 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.017180 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:08.017690 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.017840 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.018381 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.018811 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.019254 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.019886 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.020223 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.020744 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.021011 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.021397 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:08.022190 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:08.024464 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:08.044386 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:08.050386 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Pushing event deleted for resources: {'Network': ['ID=7356920a-571e-467c-9250-df782b9d8129,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:08.054554 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:08.067944 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] 10.222.0.74 "DELETE /v2.0/networks/7356920a-571e-467c-9250-df782b9d8129 HTTP/1.1" status: 204  len: 168 time: 0.9907238
Jun 01 11:15:08.070968 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37010) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:08.222119 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 121e5d5e-fe75-481f-9882-768f112ee1f8 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:08.222549 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416e76ee-acef-400e-b47c-8105dbc3e337 req-a9eb9bc0-ff27-4721-8b0a-9806db9db104 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:08.224170 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-416e76ee-acef-400e-b47c-8105dbc3e337 req-a9eb9bc0-ff27-4721-8b0a-9806db9db104 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 946 time: 0.4433339
Jun 01 11:15:08.248411 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d91045f-31a4-4b99-bc5d-723a12389d01 req-c2d03a25-4ba5-4974-afbb-249a4f6d9ac9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:08.249105 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-2d91045f-31a4-4b99-bc5d-723a12389d01 req-c2d03a25-4ba5-4974-afbb-249a4f6d9ac9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Synchronizing usage tracker for tenant:7105d2f283044a3c9f1397f5e07b0bfe on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:15:08.260830 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 121e5d5e-fe75-481f-9882-768f112ee1f8 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:08.261580 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 121e5d5e-fe75-481f-9882-768f112ee1f8 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:08.349004 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-416e76ee-acef-400e-b47c-8105dbc3e337 req-11a01aad-6525-4cfe-b2d0-c74ba824c72b tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/security-groups?id=2a42d143-115c-4881-bea6-40275871966c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1088679
Jun 01 11:15:08.349468 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-2d91045f-31a4-4b99-bc5d-723a12389d01 req-c2d03a25-4ba5-4974-afbb-249a4f6d9ac9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Unset dirty status for tenant:7105d2f283044a3c9f1397f5e07b0bfe on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:15:08.350482 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2d91045f-31a4-4b99-bc5d-723a12389d01 req-c2d03a25-4ba5-4974-afbb-249a4f6d9ac9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 932 time: 0.6687250
Jun 01 11:15:08.385597 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-5133e4a7-c6b2-4124-b043-412212af03f9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:08.387302 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-5133e4a7-c6b2-4124-b043-412212af03f9 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 946 time: 0.3867271
Jun 01 11:15:08.475508 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device c1678ffd-eeeb-49dd-802f-c62185c0fb7e no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:08.519746 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: c1678ffd-eeeb-49dd-802f-c62185c0fb7e {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:08.520274 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device c1678ffd-eeeb-49dd-802f-c62185c0fb7e not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:08.529359 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2d91045f-31a4-4b99-bc5d-723a12389d01 req-34692cde-9c75-4737-99ae-5c099d50460a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1701763
Jun 01 11:15:08.574074 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c9d83745-527c-4d1e-b61f-a188ad54fae2 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:15:08.588173 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:08.615385 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Transition to ACTIVE for port object c9d83745-527c-4d1e-b61f-a188ad54fae2 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:15:08.625235 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:08.631095 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e4b071f1-c93b-4584-8c8b-b715b32f33e4 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:08.719202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Pushing event updated for resources: {'Port': ['ID=c9d83745-527c-4d1e-b61f-a188ad54fae2,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:08.722802 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:08.782530 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Deleting port 7d85ff7b-1fb9-4870-919d-49ce962b290b {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:08.783166 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:08.793158 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-926124'] for router_interface, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.029273 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] For port 7d85ff7b-1fb9-4870-919d-49ce962b290b, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7d85ff7b-1fb9-4870-919d-49ce962b290b,segment=NetworkSegment(2030aac5-bed9-4a3d-aab1-8277fcd22311),segment_id=2030aac5-bed9-4a3d-aab1-8277fcd22311)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:09.029556 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.036469 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Attempting to bind port c9d83745-527c-4d1e-b61f-a188ad54fae2 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:15:09.036804 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Attempting to bind port c9d83745-527c-4d1e-b61f-a188ad54fae2 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:15:09.037135 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Attempting to bind port c9d83745-527c-4d1e-b61f-a188ad54fae2 on network a30966a5-dc46-445f-8d4a-d8da7c97fafd {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:15:09.097171 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Port c9d83745-527c-4d1e-b61f-a188ad54fae2 on network a30966a5-dc46-445f-8d4a-d8da7c97fafd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:15:09.097500 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Attempting to bind port c9d83745-527c-4d1e-b61f-a188ad54fae2 on network a30966a5-dc46-445f-8d4a-d8da7c97fafd {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:15:09.159294 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Calling delete_port for 7d85ff7b-1fb9-4870-919d-49ce962b290b owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:09.165050 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 14, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:15:09.165386 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Checking segment: {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:15:09.165771 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Bound using segment: {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:15:09.166203 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Bound port: c9d83745-527c-4d1e-b61f-a188ad54fae2, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '58584179-37ca-4343-8b13-9870bf67c2d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:15:09.166596 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.212376 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Deleting port af8ae178-ea25-4e8a-ab7d-730d8642caac {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:09.213004 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.289995 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:15:09.299869 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:15:09.306032 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.314512 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-975a852b-9c1f-4a13-b15b-85b81fb6a53f tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:09.339904 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] For port af8ae178-ea25-4e8a-ab7d-730d8642caac, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=af8ae178-ea25-4e8a-ab7d-730d8642caac,segment=NetworkSegment(8323217a-f39d-4f1e-8f5b-826579119c97),segment_id=8323217a-f39d-4f1e-8f5b-826579119c97)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:09.340256 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.414153 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:09.414762 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.416215 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] 10.222.0.79 "PUT /v2.0/ports/c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 200  len: 1094 time: 1.9196315
Jun 01 11:15:09.419298 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:15:09.427638 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e834def-faa5-46f4-96ec-1408ce1cc7f6" -d '{"events": [{"name": "network-changed", "server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:15:09.475820 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Calling delete_port for af8ae178-ea25-4e8a-ab7d-730d8642caac owned by network:router_interface {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:09.509723 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Pushing event updated for resources: {'Port': ['ID=c9d83745-527c-4d1e-b61f-a188ad54fae2,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:09.514473 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:15:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be6796a6-5c01-4239-bba7-329246a91d78 x-openstack-request-id: req-be6796a6-5c01-4239-bba7-329246a91d78 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:15:09.514797 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:15:09.515085 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-be6796a6-5c01-4239-bba7-329246a91d78 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:15:09.515508 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'status': 'completed', 'code': 200}
Jun 01 11:15:09.518063 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:09.520231 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.526528 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e5237a46-8f03-4ea2-b849-abcbe4f92946 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:09.533097 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['7d85ff7b-1fb9-4870-919d-49ce962b290b'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:15:09.631098 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Pushing event deleted for resources: {'Port': ['ID=7d85ff7b-1fb9-4870-919d-49ce962b290b,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:09.637068 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4f07b02b-2826-4779-b543-bbac1b2948f7 req-2c0f4179-0768-404a-9b14-445ed5233bd6 tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.74 "GET /v2.0/ports?device_id=a11e9bbf-95ca-46df-bb08-7380420cf585 HTTP/1.1" status: 200  len: 210 time: 0.0631399
Jun 01 11:15:09.639471 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:09.719284 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.724659 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-c694368f-7fb6-4bf2-8f43-70263f115f0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:09.724820 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] No DVR routers for this DVR port 7d85ff7b-1fb9-4870-919d-49ce962b290b on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:15:09.728169 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:09.745146 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-d5080b80-e174-4fa7-b9a2-06599433365a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:09.746823 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-d5080b80-e174-4fa7-b9a2-06599433365a service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1097 time: 0.2854929
Jun 01 11:15:09.749169 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] 10.222.0.79 "DELETE /v2.0/ports/7d85ff7b-1fb9-4870-919d-49ce962b290b HTTP/1.1" status: 204  len: 173 time: 1.3547041
Jun 01 11:15:09.780525 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Pushing event deleted for resources: {'Port': ['ID=af8ae178-ea25-4e8a-ab7d-730d8642caac,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:09.783758 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:09.891533 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-32bb6de7-c3b5-440d-82f6-7ebad94630a7 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 200  len: 217 time: 0.1030769
Jun 01 11:15:09.996826 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bda0ba5-6ac7-445c-8e47-827d0a637340 req-4d5d471a-e5e7-4484-aa02-928be8cd1e7f tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:09.998971 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4bda0ba5-6ac7-445c-8e47-827d0a637340 req-4d5d471a-e5e7-4484-aa02-928be8cd1e7f tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.2489450
Jun 01 11:15:10.012050 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5b120b32-c7d7-4a96-a9de-59c9afae38cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:10.014074 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-5b120b32-c7d7-4a96-a9de-59c9afae38cc service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f490a491-e776-4472-a23c-46b7b609b438 HTTP/1.1" status: 200  len: 848 time: 0.1020033
Jun 01 11:15:10.077971 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-776947', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-646716'] for router_interface, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:10.203183 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4bda0ba5-6ac7-445c-8e47-827d0a637340 req-d773b552-45dc-4ffe-a5b9-bc5b65d1de90 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1982675
Jun 01 11:15:10.223006 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-b5add436-b89d-4e0d-addb-e2f01041e7e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:10.224852 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-b5add436-b89d-4e0d-addb-e2f01041e7e0 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=a30966a5-dc46-445f-8d4a-d8da7c97fafd&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1971867
Jun 01 11:15:10.367158 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-982f5588-b680-4e3d-8071-9da57d9c87ed service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1355138
Jun 01 11:15:10.520921 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fa0088ba-27d4-4d9a-b023-a22e47136b9e req-62eaea90-3547-4e3b-a2f0-890be4318ed6 service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1464787
Jun 01 11:15:10.562714 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Router fa48cfa6-fa67-479e-86c6-8eea862fb754 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:15:10.630409 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-cdd8573c-3ffd-43f0-a63b-34ea5b9040ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:10.631980 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-cdd8573c-3ffd-43f0-a63b-34ea5b9040ab service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1097 time: 0.0689173
Jun 01 11:15:10.747090 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:15:10.757050 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] Sync routers for ids ['fa48cfa6-fa67-479e-86c6-8eea862fb754'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:15:10.763170 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37030) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:10.770749 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] Routers {'fa48cfa6-fa67-479e-86c6-8eea862fb754'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:15:10.771369 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57985fa4c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['fa48cfa6-fa67-479e-86c6-8eea862fb754'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:10.792208 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-bc24f8bd-d6ad-4f05-b0e8-78dbb29c5410 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:10.793656 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-bc24f8bd-d6ad-4f05-b0e8-78dbb29c5410 service neutron] 10.222.0.79 "GET /v2.0/networks?id=a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 200  len: 910 time: 0.1429496
Jun 01 11:15:10.801971 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] 10.222.0.74 "PUT /v2.0/routers/fa48cfa6-fa67-479e-86c6-8eea862fb754/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7278209
Jun 01 11:15:10.804422 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37034) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:10.866168 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-a386a0e6-121e-4e5b-8f60-c8b1c3febef3 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 200  len: 217 time: 0.0656471
Jun 01 11:15:10.906596 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-118142b6-f78a-4835-9428-429004a9ecb1 admin admin] Deleting subnet 6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:15:10.912496 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-118142b6-f78a-4835-9428-429004a9ecb1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:10.932386 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-1c463d5c-b21d-4941-b516-cb8764d38951 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:10.934073 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-1c463d5c-b21d-4941-b516-cb8764d38951 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f490a491-e776-4472-a23c-46b7b609b438 HTTP/1.1" status: 200  len: 848 time: 0.0616682
Jun 01 11:15:10.956001 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] Set router fa48cfa6-fa67-479e-86c6-8eea862fb754 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:15:11.015057 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-fb24314d-80ec-4c41-9ffb-c0084cf6164c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:11.016763 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-fb24314d-80ec-4c41-9ffb-c0084cf6164c service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=a30966a5-dc46-445f-8d4a-d8da7c97fafd&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0765424
Jun 01 11:15:11.037632 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-118142b6-f78a-4835-9428-429004a9ecb1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10700501'] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:11.111997 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks [] for router, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:11.161380 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-f5582015-528c-42d9-8777-73d88d0c1edc service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1359253
Jun 01 11:15:11.181086 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-118142b6-f78a-4835-9428-429004a9ecb1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:11.243199 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57985fa4c0>, [{'id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91'}], 'enable_snat': True}, 'gw_port_id': 'cf997a22-dc15-4e60-8145-58a514804936', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:45Z', 'updated_at': '2021-06-01T11:15:09Z', 'revision_number': 5, 'project_id': '65f10d0e259c4764a0a20338456489de', 'gw_port': {'id': 'cf997a22-dc15-4e60-8145-58a514804936', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:ba:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 406, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:46Z', 'updated_at': '2021-06-01T11:11:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:11.247444 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] Checking router: fa48cfa6-fa67-479e-86c6-8eea862fb754 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:15:11.256450 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] Routers {'fa48cfa6-fa67-479e-86c6-8eea862fb754'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:15:11.256947 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57985fa4c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:14:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['fa48cfa6-fa67-479e-86c6-8eea862fb754'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:11.306526 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2e834def-faa5-46f4-96ec-1408ce1cc7f6 req-c0067eb0-5dc8-4327-99bc-85a06fef56c3 service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1373179
Jun 01 11:15:11.422911 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:11.467542 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d5d92d0-9b30-4304-8754-b66f29dc75f9 req-c1cc1e9f-1467-4303-8d95-cc775e9cbd98 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:11.469152 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4d5d92d0-9b30-4304-8754-b66f29dc75f9 req-c1cc1e9f-1467-4303-8d95-cc775e9cbd98 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.1051667
Jun 01 11:15:11.486688 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] Set router fa48cfa6-fa67-479e-86c6-8eea862fb754 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:15:11.517626 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a11e9bbf-95ca-46df-bb08-7380420cf585', 'name': 'network-vif-deleted', 'tag': '7d85ff7b-1fb9-4870-919d-49ce962b290b'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:15:11.523767 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ea01a80-6b3f-424a-a665-58dec454ed26" -d '{"events": [{"server_uuid": "a11e9bbf-95ca-46df-bb08-7380420cf585", "name": "network-vif-deleted", "tag": "7d85ff7b-1fb9-4870-919d-49ce962b290b"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:15:11.540623 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4d5d92d0-9b30-4304-8754-b66f29dc75f9 req-23bc96e0-0026-4931-851f-5b6e14b03bb9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0632737
Jun 01 11:15:11.594309 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Deleting port cf997a22-dc15-4e60-8145-58a514804936 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:11.594984 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:11.600181 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:15:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3db171a6-252e-40e0-b593-dd1f859f1b3b x-openstack-request-id: req-3db171a6-252e-40e0-b593-dd1f859f1b3b {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:15:11.600537 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a11e9bbf-95ca-46df-bb08-7380420cf585", "name": "network-vif-deleted", "tag": "7d85ff7b-1fb9-4870-919d-49ce962b290b", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:15:11.600828 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-3db171a6-252e-40e0-b593-dd1f859f1b3b {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:15:11.601283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a11e9bbf-95ca-46df-bb08-7380420cf585', 'name': 'network-vif-deleted', 'tag': '7d85ff7b-1fb9-4870-919d-49ce962b290b', 'status': 'completed', 'code': 200}
Jun 01 11:15:11.677749 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-118142b6-f78a-4835-9428-429004a9ecb1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10700437', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-11313305'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:11.688781 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5df6c45d-4de6-4619-9df6-11b590cb1c46 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:11.741647 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-118142b6-f78a-4835-9428-429004a9ecb1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:11.746553 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-118142b6-f78a-4835-9428-429004a9ecb1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6ccfaae8-bb7e-4cdd-ba83-2bee1577d247,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:11.751239 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-118142b6-f78a-4835-9428-429004a9ecb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:11.760377 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-118142b6-f78a-4835-9428-429004a9ecb1 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/6ccfaae8-bb7e-4cdd-ba83-2bee1577d247 HTTP/1.1" status: 204  len: 168 time: 0.9927731
Jun 01 11:15:11.760923 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37044) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:11.785348 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57985fa4c0>, [{'id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91'}], 'enable_snat': True}, 'gw_port_id': 'cf997a22-dc15-4e60-8145-58a514804936', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:45Z', 'updated_at': '2021-06-01T11:15:09Z', 'revision_number': 5, 'project_id': '65f10d0e259c4764a0a20338456489de', 'gw_port': {'id': 'cf997a22-dc15-4e60-8145-58a514804936', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:ba:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 406, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:46Z', 'updated_at': '2021-06-01T11:11:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:11.789977 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1875f1bc-dc55-4a41-ace0-341a010c3b20 None None] The sync data for ids ['fa48cfa6-fa67-479e-86c6-8eea862fb754'] in dv-cinder-787764-3-iscsi is: [{'id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'name': 'tempest-TestMinimumBasicScenario-2125915688-router', 'tenant_id': '65f10d0e259c4764a0a20338456489de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91'}], 'enable_snat': True}, 'gw_port_id': 'cf997a22-dc15-4e60-8145-58a514804936', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:11:45Z', 'updated_at': '2021-06-01T11:15:09Z', 'revision_number': 5, 'project_id': '65f10d0e259c4764a0a20338456489de', 'gw_port': {'id': 'cf997a22-dc15-4e60-8145-58a514804936', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:ba:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa48cfa6-fa67-479e-86c6-8eea862fb754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 406, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:11:46Z', 'updated_at': '2021-06-01T11:11:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:15:11.890290 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:11.918585 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] For port cf997a22-dc15-4e60-8145-58a514804936, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=cf997a22-dc15-4e60-8145-58a514804936,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:11.918931 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.022052 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.035332 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f579396bf40>,) {'filters': {'network_id': ['10ec91f8-5d7c-496e-a32a-4dcea0b24793']}} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:12.048286 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f579396bf40>, '2030aac5-bed9-4a3d-aab1-8277fcd22311') {'for_net_delete': True} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:12.048508 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f579396bf40>, '2030aac5-bed9-4a3d-aab1-8277fcd22311') {} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:12.054436 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Calling delete_port for cf997a22-dc15-4e60-8145-58a514804936 owned by network:router_gateway {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:12.062611 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10844038'] for segment, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.078377 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.084350 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Releasing vlan 682 on physical network physnet1 to pool {{(pid=119241) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:15:12.084732 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10959794'] for segment, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]: Traceback (most recent call last):
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     timer()
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     cb(*args, **kw)
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     return func(*args, **kwargs)
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     self._notify()
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     self.callback(batched_events)
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     event.method(event)
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     return f(self, *a, **k)
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._get(url).json()
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:15:12.098476 dv-cinder-787764-3-iscsi neutron-server[119241]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:15:12.184206 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.188097 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:12.219765 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.223849 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:12.247106 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 7d85ff7b-1fb9-4870-919d-49ce962b290b no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:12.276751 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Pushing event deleted for resources: {'Port': ['ID=cf997a22-dc15-4e60-8145-58a514804936,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:12.280447 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:12.294051 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.306559 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Pushing event deleted for resources: {'Network': ['ID=10ec91f8-5d7c-496e-a32a-4dcea0b24793,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:12.309523 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:12.312052 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-48c3ba99-d345-405f-85ca-1c8841258828 admin admin] 10.222.0.74 "DELETE /v2.0/networks/10ec91f8-5d7c-496e-a32a-4dcea0b24793 HTTP/1.1" status: 204  len: 168 time: 0.5497274
Jun 01 11:15:12.354161 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 7d85ff7b-1fb9-4870-919d-49ce962b290b {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:12.354573 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 7d85ff7b-1fb9-4870-919d-49ce962b290b not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:12.381845 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-645297'] for router_gateway, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.483813 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device af8ae178-ea25-4e8a-ab7d-730d8642caac no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:12.514082 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37054) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:12.523086 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: af8ae178-ea25-4e8a-ab7d-730d8642caac {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:12.523442 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device af8ae178-ea25-4e8a-ab7d-730d8642caac not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:12.562402 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-643132', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4050'] for router, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.564516 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.565366 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d67f34d8-9185-4c67-a52c-cbf5fe8f585c admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=a83ba65361364d0fad1aa55a0f8cb7cf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0497496
Jun 01 11:15:12.567879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37058) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:12.593413 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-643584'] for router, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.593963 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router fa48cfa6-fa67-479e-86c6-8eea862fb754 {{(pid=119240) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 11:15:12.606621 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.610855 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] 10.222.0.74 "DELETE /v2.0/routers/fa48cfa6-fa67-479e-86c6-8eea862fb754 HTTP/1.1" status: 204  len: 168 time: 1.8055985
Jun 01 11:15:12.611678 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37064) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:12.635769 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d4a6e3b4-c9d5-4e96-8c70-efef1359e6e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.668353 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d4a6e3b4-c9d5-4e96-8c70-efef1359e6e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.676627 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-8e6d2a04-bba9-4508-b941-e88c7d6f7701 admin admin] Deleting subnet 60e72189-c1a7-443f-8dca-6646b19c0101 {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:15:12.679740 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8e6d2a04-bba9-4508-b941-e88c7d6f7701 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.733921 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8e6d2a04-bba9-4508-b941-e88c7d6f7701 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10700501'] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.789104 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29ac73c-2a8b-44cb-baca-895a50114108 req-a3ab2562-8199-415a-8974-0103a91d95ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:12.790557 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d29ac73c-2a8b-44cb-baca-895a50114108 req-a3ab2562-8199-415a-8974-0103a91d95ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.1141794
Jun 01 11:15:12.810700 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d4a6e3b4-c9d5-4e96-8c70-efef1359e6e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.816796 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-471679fd-dd7d-4587-a526-1e012131e433 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:12.820044 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8e6d2a04-bba9-4508-b941-e88c7d6f7701 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.832780 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4a6e3b4-c9d5-4e96-8c70-efef1359e6e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a42d143-115c-4881-bea6-40275871966c,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:12.835209 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d4a6e3b4-c9d5-4e96-8c70-efef1359e6e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:12.849221 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d4a6e3b4-c9d5-4e96-8c70-efef1359e6e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:12.852927 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d4a6e3b4-c9d5-4e96-8c70-efef1359e6e7 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/2a42d143-115c-4881-bea6-40275871966c HTTP/1.1" status: 204  len: 168 time: 0.2811213
Jun 01 11:15:12.862879 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d29ac73c-2a8b-44cb-baca-895a50114108 req-fb904c03-71ea-43c0-8ae7-239be259b742 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0653274
Jun 01 11:15:13.093753 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8e6d2a04-bba9-4508-b941-e88c7d6f7701 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10700437', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-11313305'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.099843 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-128b0216-6a9e-4517-bb1b-ea07c9de71a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:13.133391 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6d2a04-bba9-4508-b941-e88c7d6f7701 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=60e72189-c1a7-443f-8dca-6646b19c0101,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:13.136519 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8e6d2a04-bba9-4508-b941-e88c7d6f7701 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:13.139907 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8e6d2a04-bba9-4508-b941-e88c7d6f7701 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.145906 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdc3545e-b149-4863-a1b4-37818f46ee97 None None] Network c783f943-bfd7-40b4-abd5-264b3d0bdef5 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:15:13.149169 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-8e6d2a04-bba9-4508-b941-e88c7d6f7701 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/60e72189-c1a7-443f-8dca-6646b19c0101 HTTP/1.1" status: 204  len: 168 time: 0.5346036
Jun 01 11:15:13.149448 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37074) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:13.268013 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.359099 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Deleting port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:13.359385 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.428286 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] DHCP port deletion for c783f943-bfd7-40b4-abd5-264b3d0bdef5 request from dv-cinder-787764-3-iscsi {{(pid=119242) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 11:15:13.471862 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] For port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=2ea40bcb-0c35-4e50-8ff2-1a55222eba02,segment=NetworkSegment(8323217a-f39d-4f1e-8f5b-826579119c97),segment_id=8323217a-f39d-4f1e-8f5b-826579119c97)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:13.472281 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.494852 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] Deleting port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 {{(pid=119242) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:13.495238 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.602093 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] For port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=2ea40bcb-0c35-4e50-8ff2-1a55222eba02,segment=NetworkSegment(8323217a-f39d-4f1e-8f5b-826579119c97),segment_id=8323217a-f39d-4f1e-8f5b-826579119c97)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:13.602647 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.693059 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Calling delete_port for 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 owned by network:dhcp {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:13.728625 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] Calling delete_port for 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 owned by network:dhcp {{(pid=119242) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:13.746257 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.751731 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-dc44f46e-89bb-43a2-a02a-a8b2936b09c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:13.777831 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676'] for port, after_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.781476 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:13.795449 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Pushing event deleted for resources: {'Port': ['ID=2ea40bcb-0c35-4e50-8ff2-1a55222eba02,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:13.797255 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] No DVR routers for this DVR port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 on host dv-cinder-787764-3-iscsi {{(pid=119240) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:15:13.798684 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:13.826173 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] Pushing event deleted for resources: {'Port': ['ID=2ea40bcb-0c35-4e50-8ff2-1a55222eba02,revision_number=None']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:13.830069 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:13.834387 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] No DVR routers for this DVR port 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 on host dv-cinder-787764-3-iscsi {{(pid=119242) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:15:13.927410 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:13.942421 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f5793c62460>,) {'filters': {'network_id': ['c783f943-bfd7-40b4-abd5-264b3d0bdef5']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:13.955950 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f5793c62460>, '8323217a-f39d-4f1e-8f5b-826579119c97') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:13.956429 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f5793c62460>, '8323217a-f39d-4f1e-8f5b-826579119c97') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:13.976179 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:14.000628 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:14.008562 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Releasing vlan 659 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:15:14.008920 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:15:14.023405 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:15:14.122722 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:14.127561 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:14.134598 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:14.151929 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a016afa6-e536-4ba8-a903-b37354307544 req-83e04394-b46c-429f-adf7-f25223963a0c tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:14.154777 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a016afa6-e536-4ba8-a903-b37354307544 req-83e04394-b46c-429f-adf7-f25223963a0c tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.1588049
Jun 01 11:15:14.173660 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] 10.222.0.74 "DELETE /v2.0/networks/c783f943-bfd7-40b4-abd5-264b3d0bdef5 HTTP/1.1" status: 204  len: 168 time: 1.0211780
Jun 01 11:15:14.175278 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Pushing event deleted for resources: {'Network': ['ID=c783f943-bfd7-40b4-abd5-264b3d0bdef5,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:14.178109 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:14.191320 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-235d2ea1-c0bf-48cc-b816-f528b3851d12 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1210277
Jun 01 11:15:14.264648 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a016afa6-e536-4ba8-a903-b37354307544 req-b0db80b2-f3cf-4f71-8a32-d93ece0f1476 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1032057
Jun 01 11:15:14.313624 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-2b2dc60a-c457-4d26-889a-f947b315de95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:14.315109 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-2b2dc60a-c457-4d26-889a-f947b315de95 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 1099 time: 0.0994895
Jun 01 11:15:14.489889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-aa188595-4523-4d8c-aaeb-b9a8b59c46e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:14.492035 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-aa188595-4523-4d8c-aaeb-b9a8b59c46e9 service neutron] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 917 time: 0.1546025
Jun 01 11:15:14.492193 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37122) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:14.498819 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device cf997a22-dc15-4e60-8145-58a514804936 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:14.537722 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: cf997a22-dc15-4e60-8145-58a514804936 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:14.538378 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device cf997a22-dc15-4e60-8145-58a514804936 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:14.539174 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:14.575784 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:14.576574 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 2ea40bcb-0c35-4e50-8ff2-1a55222eba02 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:14.580499 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-04c89c65-4739-4b8e-a620-0f1a91b327f0 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=5c3d0a0f97d246d5a7afac5ec8c4d43c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0871081
Jun 01 11:15:14.584782 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37128) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:14.622188 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-229e146b-8fc6-4331-bad6-cb02815a4ea5 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c HTTP/1.1" status: 200  len: 1002 time: 0.1226950
Jun 01 11:15:14.655570 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9f21ac22-a83d-4ea0-b8bb-7c782d541512 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:14.684343 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9f21ac22-a83d-4ea0-b8bb-7c782d541512 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:14.706090 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-127f4735-1f4b-4174-a1a6-29927b1bf9ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:14.707700 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-127f4735-1f4b-4174-a1a6-29927b1bf9ea service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.0780523
Jun 01 11:15:14.750604 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9f21ac22-a83d-4ea0-b8bb-7c782d541512 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:14.761919 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e0566662-fef6-4a3d-b99c-7965693b2cc5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:14.787363 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f21ac22-a83d-4ea0-b8bb-7c782d541512 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b439d80e-05e2-4757-aaae-a9fee5f6d9ee,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:14.789365 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9f21ac22-a83d-4ea0-b8bb-7c782d541512 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:14.792946 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-9f21ac22-a83d-4ea0-b8bb-7c782d541512 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/b439d80e-05e2-4757-aaae-a9fee5f6d9ee HTTP/1.1" status: 204  len: 168 time: 0.2048197
Jun 01 11:15:14.792946 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9f21ac22-a83d-4ea0-b8bb-7c782d541512 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:14.801111 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-9cd8610e-d683-4d91-a600-17cbaafae154 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:14.802715 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-9cd8610e-d683-4d91-a600-17cbaafae154 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0876777
Jun 01 11:15:14.990342 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-1eda9650-48f7-4b2b-aa39-80e1c04b0602 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1787889
Jun 01 11:15:15.162098 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b94c661c-67a4-402e-85a1-c2a12a426191 req-92224fff-47f2-4490-aa44-2258a8c13a03 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1614747
Jun 01 11:15:15.251808 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37164) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:15.310056 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-843f4275-e27d-474e-b99a-36a8e0a0033f admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=65f10d0e259c4764a0a20338456489de&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0566599
Jun 01 11:15:15.314082 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37170) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:15.387554 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-43a00618-44a2-4053-a2e3-b845778cd5b8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:15.465783 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-43a00618-44a2-4053-a2e3-b845778cd5b8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:15.514008 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37176) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:15.549333 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94be68ac-84d1-4bfb-92f8-646f43d8d796 req-e2c04ac5-bd7a-4f80-8792-f4edbc50bdc9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:15.559368 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-94be68ac-84d1-4bfb-92f8-646f43d8d796 req-e2c04ac5-bd7a-4f80-8792-f4edbc50bdc9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.1535087
Jun 01 11:15:15.601472 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-43a00618-44a2-4053-a2e3-b845778cd5b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:15.610156 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:15.628330 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-94be68ac-84d1-4bfb-92f8-646f43d8d796 req-72eeedcb-df70-4f65-9dd6-a168eb57bf1b tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0632515
Jun 01 11:15:15.628330 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43a00618-44a2-4053-a2e3-b845778cd5b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1dca14a3-a373-46a8-9ac7-a18792ff81d0,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:15.649596 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-43a00618-44a2-4053-a2e3-b845778cd5b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:15.652471 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-43a00618-44a2-4053-a2e3-b845778cd5b8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:15.660586 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-43a00618-44a2-4053-a2e3-b845778cd5b8 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/1dca14a3-a373-46a8-9ac7-a18792ff81d0 HTTP/1.1" status: 204  len: 168 time: 0.3453605
Jun 01 11:15:15.673181 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:15.690088 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:15.694322 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Usage tracker for resource:security_group_rule and tenant:8df943fffdf2459cb894f5f29fb97093 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:15.697595 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:15.705121 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:15.796042 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:15.801335 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:15.813531 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:15.857048 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7084c085-a3b9-40d1-8571-d1993a5dc331,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:15.862987 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=8df943fffdf2459cb894f5f29fb97093&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3477204
Jun 01 11:15:15.864392 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:15.864885 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37184) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:15.929154 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a48ba1c9-3da1-4547-bed8-4687be5bfb4d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:15.958417 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a48ba1c9-3da1-4547-bed8-4687be5bfb4d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.015506 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a48ba1c9-3da1-4547-bed8-4687be5bfb4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.019289 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5c556693-a7de-43a4-b97b-b82d742b6184 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:16.030079 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a48ba1c9-3da1-4547-bed8-4687be5bfb4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7084c085-a3b9-40d1-8571-d1993a5dc331,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:16.034803 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a48ba1c9-3da1-4547-bed8-4687be5bfb4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:16.036801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a48ba1c9-3da1-4547-bed8-4687be5bfb4d admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.037899 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-a48ba1c9-3da1-4547-bed8-4687be5bfb4d admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/7084c085-a3b9-40d1-8571-d1993a5dc331 HTTP/1.1" status: 204  len: 168 time: 0.1721151
Jun 01 11:15:16.389365 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37198) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:16.407730 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.422493 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:16.426370 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Usage tracker for resource:security_group_rule and tenant:dc6ac9e5b6214be9a83a9c0316186fc8 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:16.429162 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:16.434864 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:16.521616 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.525175 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.532474 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-80e34167-9fac-43a9-a98b-f60f8a3155ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:16.571923 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d797f511-f52e-447e-9b91-b2df5b0287ba,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:16.576191 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=dc6ac9e5b6214be9a83a9c0316186fc8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1858211
Jun 01 11:15:16.577088 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:16.578823 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37202) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:16.611329 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.644817 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5adfecd1-cf0e-4c09-b9ea-bf91e097d75e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.671502 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5adfecd1-cf0e-4c09-b9ea-bf91e097d75e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.724780 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5adfecd1-cf0e-4c09-b9ea-bf91e097d75e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.729542 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0886b929-3773-422c-ad01-76d44c626d31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:16.739801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5adfecd1-cf0e-4c09-b9ea-bf91e097d75e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d797f511-f52e-447e-9b91-b2df5b0287ba,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:16.742102 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5adfecd1-cf0e-4c09-b9ea-bf91e097d75e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:16.747883 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5adfecd1-cf0e-4c09-b9ea-bf91e097d75e admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:16.751226 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5adfecd1-cf0e-4c09-b9ea-bf91e097d75e admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/d797f511-f52e-447e-9b91-b2df5b0287ba HTTP/1.1" status: 204  len: 168 time: 0.1692948
Jun 01 11:15:16.816812 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62cb297c-a440-4ee8-9aa1-2b9a7afa7798 req-018a28f4-0196-469f-a8f6-8bc62a06f93b tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:16.818293 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-62cb297c-a440-4ee8-9aa1-2b9a7afa7798 req-018a28f4-0196-469f-a8f6-8bc62a06f93b tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0810058
Jun 01 11:15:16.864286 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-62cb297c-a440-4ee8-9aa1-2b9a7afa7798 req-8cb85997-2d14-4136-8def-581e5b6342c4 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394006
Jun 01 11:15:17.501482 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68a4897d-71bf-408d-95bb-ff40e5118a16 req-3b2cba7b-f803-4ae6-9cb1-5e27e3478efe tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:17.504200 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-68a4897d-71bf-408d-95bb-ff40e5118a16 req-3b2cba7b-f803-4ae6-9cb1-5e27e3478efe tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0847697
Jun 01 11:15:17.548979 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-68a4897d-71bf-408d-95bb-ff40e5118a16 req-c8736b2f-8c6e-4fc8-921f-d43d85d5d2d2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399365
Jun 01 11:15:18.047618 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76f198b-6055-40c9-93c9-c376578cb602 req-248e3cc1-d6be-447a-9fb2-140648c5a2ea tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:18.048977 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d76f198b-6055-40c9-93c9-c376578cb602 req-248e3cc1-d6be-447a-9fb2-140648c5a2ea tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0798469
Jun 01 11:15:18.093399 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d76f198b-6055-40c9-93c9-c376578cb602 req-e0d641f0-9c0f-4d5a-b547-bc243faed3cd tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387378
Jun 01 11:15:18.284003 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c9d83745-527c-4d1e-b61f-a188ad54fae2 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:15:18.428657 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:18.442528 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'port_id': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'mac_address': 'fa:16:3e:b7:17:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 675, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:15:18.498756 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:18.517347 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c9d83745-527c-4d1e-b61f-a188ad54fae2 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:15:18.534146 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:18.538675 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:18.540470 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:18.614973 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=c9d83745-527c-4d1e-b61f-a188ad54fae2,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:18.618104 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:18.791200 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['c9d83745-527c-4d1e-b61f-a188ad54fae2'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:15:18.867319 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d6617ab-b1b5-4b7e-8cd6-b5fcc546cc75 req-ccaeb8db-c7b4-4d18-90d9-0c5d26ce7411 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:18.876523 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3d6617ab-b1b5-4b7e-8cd6-b5fcc546cc75 req-ccaeb8db-c7b4-4d18-90d9-0c5d26ce7411 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.2084973
Jun 01 11:15:18.927254 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3d6617ab-b1b5-4b7e-8cd6-b5fcc546cc75 req-e1148922-a0b7-4a44-bbe3-d78caa7fbe51 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0498328
Jun 01 11:15:19.278764 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0392bc11-82a2-4fb1-a299-5670030567f4 req-a91f6518-15cd-4d18-82fe-bee43e35726a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:19.280864 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0392bc11-82a2-4fb1-a299-5670030567f4 req-a91f6518-15cd-4d18-82fe-bee43e35726a tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 945 time: 0.0827801
Jun 01 11:15:19.327319 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0392bc11-82a2-4fb1-a299-5670030567f4 req-578987ed-f08f-444d-880a-5c7fffd763c0 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408616
Jun 01 11:15:20.116196 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ccae926-8850-4df0-ad7a-ba1446c08dc2 req-2d9fff53-f489-4ee7-8ea5-4540f4983e83 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:20.117650 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9ccae926-8850-4df0-ad7a-ba1446c08dc2 req-2d9fff53-f489-4ee7-8ea5-4540f4983e83 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0857470
Jun 01 11:15:20.161682 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9ccae926-8850-4df0-ad7a-ba1446c08dc2 req-6e1c0023-2bf2-4aec-b3eb-66c2e9e0f145 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385683
Jun 01 11:15:20.284077 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c9d83745-527c-4d1e-b61f-a188ad54fae2 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:15:20.360826 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port c9d83745-527c-4d1e-b61f-a188ad54fae2 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:15:20.365526 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port c9d83745-527c-4d1e-b61f-a188ad54fae2 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:15:20.365897 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:20.489689 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:20.519915 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:15:20.522511 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d2bf825d-ec55-496a-8c70-195a9ce232dc" -d '{"events": [{"server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "name": "network-vif-plugged", "status": "completed", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:15:20.533092 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d73895-807e-4926-9954-1c80cc0268d3 req-89d44755-9bdb-4bde-9f2c-df9c3c031f7e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:20.534212 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:20.541393 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:20.542236 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-59d73895-807e-4926-9954-1c80cc0268d3 req-89d44755-9bdb-4bde-9f2c-df9c3c031f7e tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 945 time: 0.0970020
Jun 01 11:15:20.543824 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-25bf6bea-4c44-4a56-9ddb-5d5298a9e0de None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:20.585204 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:15:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83b715a7-953c-415c-a410-3df9971c50b6 x-openstack-request-id: req-83b715a7-953c-415c-a410-3df9971c50b6 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:15:20.585513 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "name": "network-vif-plugged", "status": "completed", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:15:20.585778 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-83b715a7-953c-415c-a410-3df9971c50b6 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:15:20.586180 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'code': 200}
Jun 01 11:15:20.595667 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-59d73895-807e-4926-9954-1c80cc0268d3 req-5e59da67-fc21-421c-a5b9-9296873f2eb1 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0524178
Jun 01 11:15:20.662595 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=c9d83745-527c-4d1e-b61f-a188ad54fae2,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:20.665600 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:20.869748 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd83160-6664-4f1e-8055-a824c34e77e3 req-5d7724a4-4305-4c3a-933a-2d44faa2b525 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:20.871221 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8fd83160-6664-4f1e-8055-a824c34e77e3 req-5d7724a4-4305-4c3a-933a-2d44faa2b525 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1099 time: 0.0704274
Jun 01 11:15:20.914669 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8fd83160-6664-4f1e-8055-a824c34e77e3 req-f0db9e7d-618a-465c-a44e-1717da5af978 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0373518
Jun 01 11:15:21.349334 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb7aacd-5e2f-4672-9240-26822e9c04e0 req-4f324289-e37a-49d2-8e1e-ac10a3b711c8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:21.350763 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bbb7aacd-5e2f-4672-9240-26822e9c04e0 req-4f324289-e37a-49d2-8e1e-ac10a3b711c8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0816097
Jun 01 11:15:21.394680 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bbb7aacd-5e2f-4672-9240-26822e9c04e0 req-4b0beabb-24b5-4f2d-80ab-ca09c5b2b854 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0381825
Jun 01 11:15:21.790397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-797d0f78-b5da-42d5-9dcf-c4bde5e03fd2 req-7345cf4c-c136-448c-972c-5b6199fd47e2 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:21.791871 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-797d0f78-b5da-42d5-9dcf-c4bde5e03fd2 req-7345cf4c-c136-448c-972c-5b6199fd47e2 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.0802443
Jun 01 11:15:21.838894 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-797d0f78-b5da-42d5-9dcf-c4bde5e03fd2 req-4f9e16df-2e74-4b6f-8180-b03d75ce0952 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405500
Jun 01 11:15:22.446065 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37324) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:22.567541 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:22.582718 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:22.586723 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Usage tracker for resource:security_group_rule and tenant:66ad1947cb504adeb84edb30ce852e93 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:22.589661 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298b07ed-264b-4b2c-9cb5-90044f5c35a9 req-342d372a-a159-4526-8ecf-a6af70f90bca tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:22.589843 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:22.591114 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-298b07ed-264b-4b2c-9cb5-90044f5c35a9 req-342d372a-a159-4526-8ecf-a6af70f90bca tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0861552
Jun 01 11:15:22.595303 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:22.635108 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-298b07ed-264b-4b2c-9cb5-90044f5c35a9 req-06921a78-6e8b-46fe-a9e5-f4c69b0bd55c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383382
Jun 01 11:15:22.676348 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:22.680153 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:22.694750 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-27dced13-0257-4495-8b89-b71131ac6cfc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:22.703380 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e5bdc2c5-68c4-4c4d-847a-22c0eabc3c29 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:22.731574 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=66ad1947cb504adeb84edb30ce852e93&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2843735
Jun 01 11:15:22.733676 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b7ddb20-5663-4501-bc2b-818a321d548f,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:22.734791 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37330) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:22.736716 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:22.791316 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-22aafe0a-326d-4557-a918-3a81dccd8702 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:22.819980 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-22aafe0a-326d-4557-a918-3a81dccd8702 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:22.870299 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-22aafe0a-326d-4557-a918-3a81dccd8702 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:22.875807 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:22.885847 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22aafe0a-326d-4557-a918-3a81dccd8702 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b7ddb20-5663-4501-bc2b-818a321d548f,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:22.889552 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-22aafe0a-326d-4557-a918-3a81dccd8702 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:22.893185 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-22aafe0a-326d-4557-a918-3a81dccd8702 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:22.893777 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-22aafe0a-326d-4557-a918-3a81dccd8702 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/7b7ddb20-5663-4501-bc2b-818a321d548f HTTP/1.1" status: 204  len: 168 time: 0.1580193
Jun 01 11:15:23.034481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96ed65b-b3ec-4d6c-8504-d4bfc0f44d87 req-87197b78-341a-40c4-b9e9-4033ec2a4406 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:23.036123 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f96ed65b-b3ec-4d6c-8504-d4bfc0f44d87 req-87197b78-341a-40c4-b9e9-4033ec2a4406 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.0868680
Jun 01 11:15:23.081043 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f96ed65b-b3ec-4d6c-8504-d4bfc0f44d87 req-011e07be-36bf-4c24-9790-81cc6f7fdddf tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393789
Jun 01 11:15:23.180382 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37344) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:23.233493 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:23.266990 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:23.272542 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] Usage tracker for resource:security_group_rule and tenant:88e114bc2521489cb927e1c964a894a1 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:23.276498 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:23.283781 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:23.323186 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349129c7-fa20-4d0d-96a4-b555aad01a7f req-da6342c1-3d3d-41c5-bf0a-e160307d036f tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:23.324705 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-349129c7-fa20-4d0d-96a4-b555aad01a7f req-da6342c1-3d3d-41c5-bf0a-e160307d036f tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.1270831
Jun 01 11:15:23.397143 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-349129c7-fa20-4d0d-96a4-b555aad01a7f req-e2b892cc-86c0-4525-9849-6863488c41c2 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0631833
Jun 01 11:15:23.421468 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37352) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:23.427241 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:23.432479 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:23.441254 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4bf4ce38-b888-40b9-9a59-01974027b456 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:23.484387 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=88e114bc2521489cb927e1c964a894a1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3028128
Jun 01 11:15:23.486966 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37358) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:23.487453 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c46d4ff1-aa85-4069-8988-1eb571cb4998,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:23.490407 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4f545a97-4331-4de8-b3c4-1e3388f4ceb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:23.556678 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-57acfee7-0aa2-479e-a927-b29edd1a8d9a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:23.583483 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-57acfee7-0aa2-479e-a927-b29edd1a8d9a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:23.642485 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-57acfee7-0aa2-479e-a927-b29edd1a8d9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:23.652845 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-be667abc-5e28-4fa4-af58-99b16f25eea4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:23.669795 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57acfee7-0aa2-479e-a927-b29edd1a8d9a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c46d4ff1-aa85-4069-8988-1eb571cb4998,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:23.671821 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-57acfee7-0aa2-479e-a927-b29edd1a8d9a admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:23.673006 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-57acfee7-0aa2-479e-a927-b29edd1a8d9a admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/c46d4ff1-aa85-4069-8988-1eb571cb4998 HTTP/1.1" status: 204  len: 168 time: 0.1839786
Jun 01 11:15:23.675991 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-57acfee7-0aa2-479e-a927-b29edd1a8d9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:23.757935 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aaa209e-7a1b-445f-8bba-4c74df8db26a tempest-TestShelveInstance-2092281887 tempest-TestShelveInstance-2092281887-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:23.759645 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-4aaa209e-7a1b-445f-8bba-4c74df8db26a tempest-TestShelveInstance-2092281887 tempest-TestShelveInstance-2092281887-project-admin] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1094 time: 0.3367667
Jun 01 11:15:23.762768 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37370) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:23.768730 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Request body: {'floatingip': {'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'port_id': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'fixed_ip_address': '172.20.0.14'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:15:23.776831 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:23.786953 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Usage tracker for resource:floatingip and tenant:7105d2f283044a3c9f1397f5e07b0bfe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:23.790555 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:23.804493 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:23.821207 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for floatingip, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:23.921629 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc91a975-5032-45a8-af59-296b6be679d8 req-2e646dcc-322b-4b5c-9bb5-c31fb44b3580 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:23.923128 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dc91a975-5032-45a8-af59-296b6be679d8 req-2e646dcc-322b-4b5c-9bb5-c31fb44b3580 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0879276
Jun 01 11:15:23.971074 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dc91a975-5032-45a8-af59-296b6be679d8 req-9d72c73a-3595-42d5-923b-196f089f2faa tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414937
Jun 01 11:15:23.971801 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.121188 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Allocated IP 172.27.3.219 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/9a5a19d7-d9b7-4747-a9b3-6b5bc69ead6e) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:15:24.366567 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.396959 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.402667 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d29b8659-6e96-429c-9b72-8d452e982f7c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:24.465149 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:15:24.468152 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:15:24.471531 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:15:24.478587 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37392) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:24.505360 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'Port': ['ID=9a5a19d7-d9b7-4747-a9b3-6b5bc69ead6e,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:24.511455 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:24.596296 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-676417233-network', 'tenant_id': '24a6e4a73a9d4500ad014da714257d53'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:15:24.600832 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:24.604709 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Usage tracker for resource:network and tenant:24a6e4a73a9d4500ad014da714257d53 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:24.608010 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:24.614498 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:24.625097 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Made reservation on behalf of 24a6e4a73a9d4500ad014da714257d53 for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:15:24.627476 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.640588 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.655325 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:24.659943 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Usage tracker for resource:security_group_rule and tenant:24a6e4a73a9d4500ad014da714257d53 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:24.667488 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:24.674154 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:24.766808 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.770698 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.773541 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-603889b9-5fba-4461-8ef7-8257e6b2ffa3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:24.803822 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 691}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:15:24.809030 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7d9c515-cea2-4e7f-ab9a-dd44bfd2a87a,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:24.812706 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:24.816212 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.816568 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Added segment 7390abf2-8303-457d-a360-e1bc72d9ebc4 of type vlan for network d2d73458-6917-47a0-b030-d27d51594bb3
Jun 01 11:15:24.850468 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.883015 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.884755 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:24.885510 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.891193 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-10a0e6c4-1fff-4b3d-8cea-5b60c929d576 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:24.916914 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for floatingip, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.995166 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:24.995461 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Pushing event updated for resources: {'Network': ['ID=d2d73458-6917-47a0-b030-d27d51594bb3,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:24.999012 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:25.002896 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.5230134
Jun 01 11:15:25.003650 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37406) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:25.010206 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Request body: {'subnet': {'network_id': 'd2d73458-6917-47a0-b030-d27d51594bb3', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-676417233-subnet', 'tenant_id': '24a6e4a73a9d4500ad014da714257d53', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:15:25.014087 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network d2d73458-6917-47a0-b030-d27d51594bb3 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:15:25.017623 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:25.021487 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Usage tracker for resource:subnet and tenant:24a6e4a73a9d4500ad014da714257d53 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:25.024495 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:25.031168 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:25.044915 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Made reservation on behalf of 24a6e4a73a9d4500ad014da714257d53 for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:15:25.048914 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10623449'] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:25.232627 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:25.240723 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:25.246179 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-60acd1aa-6578-469c-a524-d08d7b368aaf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:25.253116 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-1bbacab1-2ff9-4c82-a9dc-26cd91167851 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:25.272186 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66785fc1-40ce-4a70-bda1-0977926fa410 req-61e13b40-5a56-43f7-80da-20787f14b220 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:25.273707 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-66785fc1-40ce-4a70-bda1-0977926fa410 req-61e13b40-5a56-43f7-80da-20787f14b220 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.1232100
Jun 01 11:15:25.328638 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:25.355991 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event updated for resources: {'Port': ['ID=9a5a19d7-d9b7-4747-a9b3-6b5bc69ead6e,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:25.360418 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:25.367607 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:25.464539 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-66785fc1-40ce-4a70-bda1-0977926fa410 req-71e23c85-f39a-468f-8e04-28216962b686 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1620266
Jun 01 11:15:25.555735 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.l3_db [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Floating IP 2bdaa297-c3ca-4e9c-b6e0-69a05b151fe6 associated. External IP: 172.27.3.219, port: c9d83745-527c-4d1e-b61f-a188ad54fae2.
Jun 01 11:15:25.724355 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10882903', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10623439'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:25.729200 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:25.803459 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2d254eac-a4cd-450e-972c-0ee82b44d7bb,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:25.806150 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:25.815193 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Checking segment: {'id': '7390abf2-8303-457d-a360-e1bc72d9ebc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 691, 'network_id': 'd2d73458-6917-47a0-b030-d27d51594bb3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:15:25.815693 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Network hostable DHCP agents. Network: d2d73458-6917-47a0-b030-d27d51594bb3, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:15:25.832986 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Network d2d73458-6917-47a0-b030-d27d51594bb3 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:15:25.841865 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, d2d73458-6917-47a0-b030-d27d51594bb3) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:15:25.852261 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72434491-c878-4bb6-be8a-a8b882d76f2d None None] Network d2d73458-6917-47a0-b030-d27d51594bb3 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:15:25.852689 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:25.853266 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:25.876693 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.8699048
Jun 01 11:15:26.029229 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:15:26.060489 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-159b16f0-a351-4289-bb77-52b2c8535a75 None None] Network d2d73458-6917-47a0-b030-d27d51594bb3 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:15:26.222050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:15:26.249064 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.249691 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] Sync routers for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:15:26.269189 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:15:26.269996 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798097f10>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:15:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:26.307845 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.5433695
Jun 01 11:15:26.308530 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:15:26.310858 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ec3c6c3-518e-4bd0-b580-2811882557b5" -d '{"events": [{"name": "network-changed", "server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:15:26.365552 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:15:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de77fb08-78a3-4f85-be3b-c44c5020c8bb x-openstack-request-id: req-de77fb08-78a3-4f85-be3b-c44c5020c8bb {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:15:26.365886 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:15:26.366180 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-de77fb08-78a3-4f85-be3b-c44c5020c8bb {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:15:26.366618 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'status': 'completed', 'code': 200}
Jun 01 11:15:26.454288 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37434) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:26.457444 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.460835 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1974092163-network', 'tenant_id': 'fd479b2787ab481895eb207c6ed3cfbd'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:15:26.465455 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:26.470554 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Usage tracker for resource:network and tenant:fd479b2787ab481895eb207c6ed3cfbd is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:26.474049 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-ccaf699c-58b4-4521-8c6d-be5297f855cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:26.474589 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:26.475578 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-ccaf699c-58b4-4521-8c6d-be5297f855cb service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1099 time: 0.0865204
Jun 01 11:15:26.476854 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:15:26.480421 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:26.493326 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Made reservation on behalf of fd479b2787ab481895eb207c6ed3cfbd for: {'network': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:15:26.495933 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.516235 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.533102 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:26.538065 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Usage tracker for resource:security_group_rule and tenant:fd479b2787ab481895eb207c6ed3cfbd is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:26.541520 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:26.548333 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:26.667917 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-7458c49f-b0e3-48b5-af3a-075005598bc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:26.669221 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.669857 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-7458c49f-b0e3-48b5-af3a-075005598bc1 service neutron] 10.222.0.79 "GET /v2.0/networks?id=a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 200  len: 910 time: 0.1868675
Jun 01 11:15:26.674004 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.679310 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-3bad3ea2-3431-4402-b982-ad0fac2d6532 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:26.696770 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 667}  {{(pid=119240) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:15:26.711876 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.712579 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.segments_db [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Added segment f707ef35-fc37-4c7f-b6d7-48d171094dad of type vlan for network 13c15f32-fa64-4331-9614-cecd77c90fbe
Jun 01 11:15:26.735063 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2c31edc-1918-4ff0-90aa-7b3359816215,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:26.738944 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:26.759784 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.796551 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.798299 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:26.800541 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:26.806290 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-da559425-670a-4fea-b3a5-e7b10e47c743 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:26.829732 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-7d624074-75d5-449a-9df1-e7d6c0738ae6 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 200  len: 1000 time: 0.1267731
Jun 01 11:15:26.885684 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5075bdd6-11da-4e65-886c-a1a1eebe61a4 req-1da7d435-c756-4695-8f79-b93bd2bf277c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:26.887969 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5075bdd6-11da-4e65-886c-a1a1eebe61a4 req-1da7d435-c756-4695-8f79-b93bd2bf277c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.2165480
Jun 01 11:15:26.897568 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798097f10>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '2bdaa297-c3ca-4e9c-b6e0-69a05b151fe6', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'floating_ip_address': '172.27.3.219', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'port_id': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 516, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'mac_address': 'fa:16:3e:b7:17:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:15:24Z', 'updated_at': '2021-06-01T11:15:24Z', 'revision_number': 0, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:37Z', 'revision_number': 5, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:26.901946 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] Checking router: 5fb046d6-be4d-48d1-adb9-9caf08ce3958 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:15:26.910836 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:15:26.911445 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798097f10>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:15:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:26.925871 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.4703062
Jun 01 11:15:26.926371 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37442) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:26.926965 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Pushing event updated for resources: {'Network': ['ID=13c15f32-fa64-4331-9614-cecd77c90fbe,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:26.927866 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-426be33b-d566-4b8f-8d9a-5df47ae9eb75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:26.929297 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-426be33b-d566-4b8f-8d9a-5df47ae9eb75 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f490a491-e776-4472-a23c-46b7b609b438 HTTP/1.1" status: 200  len: 848 time: 0.0926633
Jun 01 11:15:26.932383 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:26.965830 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 13c15f32-fa64-4331-9614-cecd77c90fbe details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:15:26.979311 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Request body: {'subnet': {'network_id': '13c15f32-fa64-4331-9614-cecd77c90fbe', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1974092163-subnet', 'tenant_id': 'fd479b2787ab481895eb207c6ed3cfbd', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:15:26.996058 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:27.001237 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5075bdd6-11da-4e65-886c-a1a1eebe61a4 req-b2d6fcc1-70c3-4914-b758-f8d46221ed16 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1046343
Jun 01 11:15:27.005615 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Usage tracker for resource:subnet and tenant:fd479b2787ab481895eb207c6ed3cfbd is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:27.009140 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:27.026414 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:27.048298 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Made reservation on behalf of fd479b2787ab481895eb207c6ed3cfbd for: {'subnet': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:15:27.050877 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10623449'] for subnet, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:27.133711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-3704c942-1580-4e0f-a323-51ba617dbddf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:27.135217 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-3704c942-1580-4e0f-a323-51ba617dbddf service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=a30966a5-dc46-445f-8d4a-d8da7c97fafd&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1947970
Jun 01 11:15:27.217082 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:15:27.321745 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-a3f83b91-8b3b-4ac1-ae7e-967c22c965ff service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1801255
Jun 01 11:15:27.515193 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7ec3c6c3-518e-4bd0-b580-2811882557b5 req-18300bc8-0940-455d-8ca1-fbdfb3b180a5 service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1868095
Jun 01 11:15:27.571007 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798097f10>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '2bdaa297-c3ca-4e9c-b6e0-69a05b151fe6', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'floating_ip_address': '172.27.3.219', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'port_id': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 516, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'mac_address': 'fa:16:3e:b7:17:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:15:24Z', 'updated_at': '2021-06-01T11:15:24Z', 'revision_number': 0, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:37Z', 'revision_number': 5, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:27.574949 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a244400f-deeb-4288-bb2d-5d23b5d64bdf None None] The sync data for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi is: [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '2bdaa297-c3ca-4e9c-b6e0-69a05b151fe6', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'floating_ip_address': '172.27.3.219', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'port_id': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 516, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'mac_address': 'fa:16:3e:b7:17:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:15:24Z', 'updated_at': '2021-06-01T11:15:24Z', 'revision_number': 0, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:37Z', 'revision_number': 5, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:15:27.685373 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10882903', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10623439'] for subnet, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:27.691433 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:27.752795 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:27.780530 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9513936c-3483-4878-afee-33e5bad07f58 None None] New status for floating IP 2bdaa297-c3ca-4e9c-b6e0-69a05b151fe6: ACTIVE {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:15:27.867699 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f6149b73-5c39-42da-aaf3-24b7cbad6627,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:27.871104 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:27.876989 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Checking segment: {'id': 'f707ef35-fc37-4c7f-b6d7-48d171094dad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 667, 'network_id': '13c15f32-fa64-4331-9614-cecd77c90fbe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:15:27.877342 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Network hostable DHCP agents. Network: 13c15f32-fa64-4331-9614-cecd77c90fbe, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119241) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:15:27.895127 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Network 13c15f32-fa64-4331-9614-cecd77c90fbe is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119241) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:15:27.905049 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 13c15f32-fa64-4331-9614-cecd77c90fbe) {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:15:27.913409 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:27.913993 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:27.914849 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2338de9c-a5f6-46b4-9d32-369495d3a3a7 None None] Network 13c15f32-fa64-4331-9614-cecd77c90fbe requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:15:27.935343 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-5a62e484-95cb-41c3-99a9-404883fd4a98 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.9981890
Jun 01 11:15:28.144852 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-238ec82a-2bcd-482d-b041-898f4da1d867 None None] Network 13c15f32-fa64-4331-9614-cecd77c90fbe requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:15:28.206648 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173733a0-9c91-438d-856f-f952e3485944 req-4703c141-3c47-4e84-920f-48f5b32fd560 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:28.208134 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-173733a0-9c91-438d-856f-f952e3485944 req-4703c141-3c47-4e84-920f-48f5b32fd560 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0798445
Jun 01 11:15:28.258245 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-173733a0-9c91-438d-856f-f952e3485944 req-70c84d70-fea3-4f7d-81b5-35358d6ef8f4 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407643
Jun 01 11:15:29.448075 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-414da4a1-70d7-47b6-aa65-974970e8570e req-d711b835-28f0-4ea4-8d88-7443153f54e1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:29.449511 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-414da4a1-70d7-47b6-aa65-974970e8570e req-d711b835-28f0-4ea4-8d88-7443153f54e1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0783718
Jun 01 11:15:29.493091 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-414da4a1-70d7-47b6-aa65-974970e8570e req-e9d1ae49-2914-4186-b829-4ba6f3ce0f71 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0375340
Jun 01 11:15:30.683432 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc167e07-d043-44f0-a6d2-8697673d0458 req-233d5f3e-9d7a-45f6-8eda-569396573f3b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:30.684917 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bc167e07-d043-44f0-a6d2-8697673d0458 req-233d5f3e-9d7a-45f6-8eda-569396573f3b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0833354
Jun 01 11:15:30.733544 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bc167e07-d043-44f0-a6d2-8697673d0458 req-5e0b1c9d-1cff-4b7e-9fde-d212ff2e4473 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430031
Jun 01 11:15:31.922830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1728214-116c-4640-9b39-5e8fa522533f req-f599fa94-ef0d-4a69-bf9f-1b40fd906c42 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:31.924313 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b1728214-116c-4640-9b39-5e8fa522533f req-f599fa94-ef0d-4a69-bf9f-1b40fd906c42 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0833561
Jun 01 11:15:31.970199 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b1728214-116c-4640-9b39-5e8fa522533f req-4c1ea10e-d974-41de-ad87-12624a79d3c2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400770
Jun 01 11:15:33.170810 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4dbafd-cc3c-4228-baea-83fe936be2c1 req-b2d1dbd3-b8b8-4d31-bd82-64dc4670651c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:33.172309 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9f4dbafd-cc3c-4228-baea-83fe936be2c1 req-b2d1dbd3-b8b8-4d31-bd82-64dc4670651c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0904162
Jun 01 11:15:33.216127 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9f4dbafd-cc3c-4228-baea-83fe936be2c1 req-ef79f2a9-34dd-46b3-9051-b87ff060d7ed tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0380955
Jun 01 11:15:34.422618 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc87d6f-eb9e-412b-a05c-f5cb13e38806 req-6f83404f-1588-467b-8e26-4dcfd12649e5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:34.424398 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dcc87d6f-eb9e-412b-a05c-f5cb13e38806 req-6f83404f-1588-467b-8e26-4dcfd12649e5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0905726
Jun 01 11:15:34.477372 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dcc87d6f-eb9e-412b-a05c-f5cb13e38806 req-29fcb703-5702-49e6-ad1a-1930dc222a9d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0471373
Jun 01 11:15:35.686898 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b192a053-8d55-4ef9-a488-3e3acb510772 req-8d97b8db-96d3-411b-a3ee-72989eed0b13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:35.689190 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b192a053-8d55-4ef9-a488-3e3acb510772 req-8d97b8db-96d3-411b-a3ee-72989eed0b13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0901377
Jun 01 11:15:35.751883 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b192a053-8d55-4ef9-a488-3e3acb510772 req-790953a2-bf49-4059-aff3-a9487e3dc46f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0558250
Jun 01 11:15:36.417720 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:15:36.586607 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:36.600978 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'port_id': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'mac_address': 'fa:16:3e:dc:95:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:15:36.665696 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:36.689662 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:15:36.710242 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:36.715619 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:36.717896 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:36.803404 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=6']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:36.807036 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:36.827048 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:15:37.005890 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39dc2932-9f05-4328-84de-5c4c073011cf req-ff641d30-a3a4-4e1c-9f3a-789ed1a16ac2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:37.014485 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-39dc2932-9f05-4328-84de-5c4c073011cf req-ff641d30-a3a4-4e1c-9f3a-789ed1a16ac2 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 945 time: 0.1314261
Jun 01 11:15:37.072250 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-39dc2932-9f05-4328-84de-5c4c073011cf req-b535e627-8417-4a78-9b3d-a21e3d617372 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0564859
Jun 01 11:15:37.810909 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:15:38.265708 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87f384c-af1b-47e5-8987-eba5153be9d5 req-61f8aefd-4f4c-42c3-b626-c174b95913cb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:38.267288 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e87f384c-af1b-47e5-8987-eba5153be9d5 req-61f8aefd-4f4c-42c3-b626-c174b95913cb tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 945 time: 0.0861940
Jun 01 11:15:38.316763 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e87f384c-af1b-47e5-8987-eba5153be9d5 req-2732f617-0239-452f-88f7-2025f4da1e58 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435445
Jun 01 11:15:38.428497 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:15:38.506765 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:15:38.507139 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:38.641860 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:38.681435 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:15:38.683937 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65082497-106a-4a42-bfdf-2fbc3e79e12e" -d '{"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-plugged", "status": "completed", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:15:38.706264 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:38.713474 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:38.715558 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:38.757675 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:15:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b6e2f0a-de35-4107-829d-796d92ff9723 x-openstack-request-id: req-4b6e2f0a-de35-4107-829d-796d92ff9723 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:15:38.757983 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-plugged", "status": "completed", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:15:38.758249 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-4b6e2f0a-de35-4107-829d-796d92ff9723 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:15:38.758658 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'code': 200}
Jun 01 11:15:38.794524 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=7']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:38.797688 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:39.543187 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db9d00ef-c33a-42b6-aae5-3338cda8350c req-d9e14bc0-2ed6-429f-a07b-917ce8e98aa4 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:39.545480 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-db9d00ef-c33a-42b6-aae5-3338cda8350c req-d9e14bc0-2ed6-429f-a07b-917ce8e98aa4 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0999081
Jun 01 11:15:39.608800 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-db9d00ef-c33a-42b6-aae5-3338cda8350c req-317a8e23-5fc3-4ebc-b2c6-c7b64be4e548 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0561454
Jun 01 11:15:40.822190 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25907b3d-f26f-43c9-804b-7801b91db2c9 req-c0e8c6f8-2c46-4247-bcfd-a9b91a01cadc tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:40.824768 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-25907b3d-f26f-43c9-804b-7801b91db2c9 req-c0e8c6f8-2c46-4247-bcfd-a9b91a01cadc tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0959949
Jun 01 11:15:40.880870 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-25907b3d-f26f-43c9-804b-7801b91db2c9 req-1b8e05ab-e6fa-40e6-b6ce-068d1fe3d8a1 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0503464
Jun 01 11:15:42.135001 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-009b0415-9aaf-4720-84cd-c615d20df161 req-3132d1ab-5e96-473b-a0ae-ed6dd1ea336c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:42.136801 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-009b0415-9aaf-4720-84cd-c615d20df161 req-3132d1ab-5e96-473b-a0ae-ed6dd1ea336c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.1319809
Jun 01 11:15:42.209514 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-009b0415-9aaf-4720-84cd-c615d20df161 req-9b6d52ac-3d1c-4c63-b9fc-6bfb99ac10df tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0603042
Jun 01 11:15:43.447498 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ab42cb-4e1f-4528-9f82-889aa3b52633 req-595006ff-c363-4fb6-91fe-5d9d14d45982 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:43.450820 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-80ab42cb-4e1f-4528-9f82-889aa3b52633 req-595006ff-c363-4fb6-91fe-5d9d14d45982 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0913696
Jun 01 11:15:43.516447 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-80ab42cb-4e1f-4528-9f82-889aa3b52633 req-9939b1bd-4491-482c-9ab8-986f784b7d16 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0593784
Jun 01 11:15:44.748532 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd2ccce-c621-4cd7-b7cd-319e98ddb728 req-43aeb8ef-0b3c-47bd-a39f-84ecbb5d715d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:44.750886 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6dd2ccce-c621-4cd7-b7cd-319e98ddb728 req-43aeb8ef-0b3c-47bd-a39f-84ecbb5d715d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.1153882
Jun 01 11:15:44.802038 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6dd2ccce-c621-4cd7-b7cd-319e98ddb728 req-af9b5962-1e64-496c-8c0a-d5da7e76fc7c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440745
Jun 01 11:15:44.934425 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37694) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:44.998215 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_v2 [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Deleting subnet 2d254eac-a4cd-450e-972c-0ee82b44d7bb {{(pid=119241) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:15:45.001730 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:45.051839 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10844045'] for subnet, precommit_delete_associations {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:45.108382 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:45.435832 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10882836', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10623430'] for subnet, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:45.440947 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-eaa7c178-14f9-4479-a7e8-d74e17e23308 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:45.478047 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2d254eac-a4cd-450e-972c-0ee82b44d7bb,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:45.485292 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:45.488190 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.488563 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.488925 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.489281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.489633 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.489983 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.490331 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.490679 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.491025 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.491385 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.491737 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.492082 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:15:45.498020 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/2d254eac-a4cd-450e-972c-0ee82b44d7bb HTTP/1.1" status: 204  len: 168 time: 0.5625737
Jun 01 11:15:45.498932 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2c522815-7496-4a79-9e50-7bc7147736b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:45.500496 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37712) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:45.658374 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:45.724954 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-dea1b379-fdf8-45e8-9f70-9033f884d27b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:45.726454 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-dea1b379-fdf8-45e8-9f70-9033f884d27b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 1099 time: 0.1549985
Jun 01 11:15:45.867909 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:45.894340 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f57937c0df0>,) {'filters': {'network_id': ['d2d73458-6917-47a0-b030-d27d51594bb3']}} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:45.916118 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f57937c0df0>, '7390abf2-8303-457d-a360-e1bc72d9ebc4') {'for_net_delete': True} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:45.916297 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f57937c0df0>, '7390abf2-8303-457d-a360-e1bc72d9ebc4') {} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:45.961596 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10844038'] for segment, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.005074 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.028318 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Releasing vlan 691 on physical network physnet1 to pool {{(pid=119241) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:15:46.028699 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10959794'] for segment, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]: Traceback (most recent call last):
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     timer()
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     cb(*args, **kw)
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     return func(*args, **kwargs)
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     self._notify()
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     self.callback(batched_events)
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     event.method(event)
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     return f(self, *a, **k)
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._get(url).json()
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:15:46.043147 dv-cinder-787764-3-iscsi neutron-server[119241]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:15:46.050587 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-87af26c2-8cf8-4ef2-b98d-0c0ea02fb25c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:46.052045 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-87af26c2-8cf8-4ef2-b98d-0c0ea02fb25c service neutron] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 917 time: 0.2730625
Jun 01 11:15:46.207889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.221072 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.223317 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7a1eb2f7-018d-49f9-bb1a-fe1e6ee536a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:46.251843 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-147793fc-1f50-4a21-9162-f33d77b4bcef req-148f1423-0f88-421b-88ad-d6bc56f77038 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:46.253268 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-147793fc-1f50-4a21-9162-f33d77b4bcef req-148f1423-0f88-421b-88ad-d6bc56f77038 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.3297622
Jun 01 11:15:46.254887 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-0a75d98d-c01d-4d79-9867-05549d59ce30 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c HTTP/1.1" status: 200  len: 1002 time: 0.1577764
Jun 01 11:15:46.256151 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Pushing event deleted for resources: {'Network': ['ID=d2d73458-6917-47a0-b030-d27d51594bb3,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:46.261106 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] 10.222.0.74 "DELETE /v2.0/networks/d2d73458-6917-47a0-b030-d27d51594bb3 HTTP/1.1" status: 204  len: 168 time: 0.7572210
Jun 01 11:15:46.261106 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5884337a-6216-46c6-a9d0-9344c6c51278 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:46.261842 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37724) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:46.324486 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-fca91b7d-8fad-4139-9d00-c057d3bff1f9 admin admin] Deleting subnet f6149b73-5c39-42da-aaf3-24b7cbad6627 {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:15:46.327548 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fca91b7d-8fad-4139-9d00-c057d3bff1f9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.354117 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-147793fc-1f50-4a21-9162-f33d77b4bcef req-d8d7d40d-5118-4090-91bf-3398d9836f51 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0943727
Jun 01 11:15:46.362078 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-4745a644-8f3b-45d2-8b2c-f80467db8638 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:46.363497 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-4745a644-8f3b-45d2-8b2c-f80467db8638 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.0805707
Jun 01 11:15:46.385529 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fca91b7d-8fad-4139-9d00-c057d3bff1f9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10700501'] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.442750 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fca91b7d-8fad-4139-9d00-c057d3bff1f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.443814 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-2c340534-8d67-4d6e-9eba-24798cc7c7a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:46.445293 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-2c340534-8d67-4d6e-9eba-24798cc7c7a4 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0738897
Jun 01 11:15:46.581122 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-d988e382-1842-47cf-a9be-ee5f6c7e4d69 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1284654
Jun 01 11:15:46.627073 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.717219 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fca91b7d-8fad-4139-9d00-c057d3bff1f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10700437', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-11313305'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.722312 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1bba2976-168d-4533-ad2d-0ec64255dbb4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:46.737179 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e76c2562-d427-4e9b-b633-3d060f5ccb80 req-f0b7b928-abc0-419d-a3a9-ce376aadf75c service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1480932
Jun 01 11:15:46.756435 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fca91b7d-8fad-4139-9d00-c057d3bff1f9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f6149b73-5c39-42da-aaf3-24b7cbad6627,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:46.759391 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fca91b7d-8fad-4139-9d00-c057d3bff1f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:46.760985 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-fca91b7d-8fad-4139-9d00-c057d3bff1f9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.766958 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-fca91b7d-8fad-4139-9d00-c057d3bff1f9 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/f6149b73-5c39-42da-aaf3-24b7cbad6627 HTTP/1.1" status: 204  len: 168 time: 0.5041995
Jun 01 11:15:46.769425 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37728) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:46.872867 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:46.994100 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.006963 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f57929249d0>,) {'filters': {'network_id': ['13c15f32-fa64-4331-9614-cecd77c90fbe']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:47.019523 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f57929249d0>, 'f707ef35-fc37-4c7f-b6d7-48d171094dad') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:47.019900 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f57929249d0>, 'f707ef35-fc37-4c7f-b6d7-48d171094dad') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:47.031401 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.047632 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.053872 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Releasing vlan 667 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:15:47.054339 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:15:47.068214 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:15:47.146828 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.150552 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:47.163923 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.173187 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Pushing event deleted for resources: {'Network': ['ID=13c15f32-fa64-4331-9614-cecd77c90fbe,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:47.175743 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] 10.222.0.74 "DELETE /v2.0/networks/13c15f32-fa64-4331-9614-cecd77c90fbe HTTP/1.1" status: 204  len: 168 time: 0.4053867
Jun 01 11:15:47.176662 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1686f991-bd4c-47b5-bfc7-bd85efbda970 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:47.362753 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37744) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:47.413991 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-c78923f1-ba5f-4c56-9b8d-cf20ad09aa81 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=24a6e4a73a9d4500ad014da714257d53&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0499406
Jun 01 11:15:47.416475 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37752) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:47.478802 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75532810-9a3d-4c5e-aebb-489775103f33 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.511164 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75532810-9a3d-4c5e-aebb-489775103f33 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.564534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d6cc8a-bfff-45d2-946a-a45deb6b1677 req-dae7e30b-61bc-4240-af4f-26067bb5d4b4 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:47.566941 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-44d6cc8a-bfff-45d2-946a-a45deb6b1677 req-dae7e30b-61bc-4240-af4f-26067bb5d4b4 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0958993
Jun 01 11:15:47.627078 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-44d6cc8a-bfff-45d2-946a-a45deb6b1677 req-7a511374-d3c5-4bdd-ade1-2ffe489f6c18 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0454493
Jun 01 11:15:47.674254 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75532810-9a3d-4c5e-aebb-489775103f33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.679475 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7e32e5c9-5d4d-4b54-b777-b1599aeab2fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:47.692034 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75532810-9a3d-4c5e-aebb-489775103f33 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7d9c515-cea2-4e7f-ab9a-dd44bfd2a87a,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:47.694536 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-75532810-9a3d-4c5e-aebb-489775103f33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:47.695706 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-75532810-9a3d-4c5e-aebb-489775103f33 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:47.696979 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-75532810-9a3d-4c5e-aebb-489775103f33 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/e7d9c515-cea2-4e7f-ab9a-dd44bfd2a87a HTTP/1.1" status: 204  len: 168 time: 0.2792664
Jun 01 11:15:47.749061 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ac6494-6c2d-4089-9031-4bbe176a1f37 req-92c118bc-583d-4ea7-98a1-a549731733d1 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:47.750521 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-50ac6494-6c2d-4089-9031-4bbe176a1f37 req-92c118bc-583d-4ea7-98a1-a549731733d1 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 946 time: 0.0837052
Jun 01 11:15:47.886219 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-50ac6494-6c2d-4089-9031-4bbe176a1f37 req-e197ebe1-f7ff-4740-9254-5d1a76626e66 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1300318
Jun 01 11:15:48.042641 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37764) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:48.091227 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-13e16bb8-4e61-488f-b16a-d7be03eb5f93 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=fd479b2787ab481895eb207c6ed3cfbd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0473237
Jun 01 11:15:48.093658 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37768) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:48.150478 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0ad6da-2793-48d0-8175-746093fd0c6a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:48.175315 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0ad6da-2793-48d0-8175-746093fd0c6a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:48.228088 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0ad6da-2793-48d0-8175-746093fd0c6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:48.232205 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:48.242892 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b0ad6da-2793-48d0-8175-746093fd0c6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2c31edc-1918-4ff0-90aa-7b3359816215,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:48.247736 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8b0ad6da-2793-48d0-8175-746093fd0c6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:48.250008 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0ad6da-2793-48d0-8175-746093fd0c6a admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:48.251169 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-8b0ad6da-2793-48d0-8175-746093fd0c6a admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/c2c31edc-1918-4ff0-90aa-7b3359816215 HTTP/1.1" status: 204  len: 168 time: 0.1565471
Jun 01 11:15:48.833414 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e7c0a84-0299-4647-b67d-5da07b9aa0d1 req-fbf82354-dc83-42b9-955b-bc28330ef6cc tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:48.834763 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7e7c0a84-0299-4647-b67d-5da07b9aa0d1 req-fbf82354-dc83-42b9-955b-bc28330ef6cc tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.0831354
Jun 01 11:15:48.890539 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7e7c0a84-0299-4647-b67d-5da07b9aa0d1 req-870748cb-cd29-4477-8c30-bb62ba52490f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0494707
Jun 01 11:15:49.088448 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f737b850-1d5a-4c88-ac4b-7604f5f0efac req-cb306bc1-0abd-4486-ba0f-a26cbb8664c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:49.089959 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f737b850-1d5a-4c88-ac4b-7604f5f0efac req-cb306bc1-0abd-4486-ba0f-a26cbb8664c5 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 946 time: 0.0886133
Jun 01 11:15:49.140617 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f737b850-1d5a-4c88-ac4b-7604f5f0efac req-2c131fed-6322-48a2-979e-1ca9cc9c97dc tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430884
Jun 01 11:15:49.507196 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-167adab3-f41c-45ff-8eef-3c27571dc57e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:49.508678 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-167adab3-f41c-45ff-8eef-3c27571dc57e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 946 time: 0.0809257
Jun 01 11:15:49.655876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Deleting port 63851119-2409-4ad5-a740-0157c795436f {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:49.656218 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:49.689767 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37832) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:49.800024 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] For port 63851119-2409-4ad5-a740-0157c795436f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=63851119-2409-4ad5-a740-0157c795436f,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:49.800385 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:49.813492 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:49.827882 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:15:49.832040 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Usage tracker for resource:security_group_rule and tenant:28ebe10b7325471ebb1aff01a2a04d14 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:15:49.835176 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:15:49.841485 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:15:49.948002 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:49.952093 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:49.960910 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1d217de5-41e3-45d2-915e-ce622a62c9f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:50.001430 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=28ebe10b7325471ebb1aff01a2a04d14&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3099170
Jun 01 11:15:50.002369 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=581186f3-2036-4adf-9115-5da7004d9246,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:50.004108 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37842) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:50.005861 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:50.152219 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:50.152585 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:50.152887 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Floating IP 8e5712a1-35b2-4f01-a2cc-543cbca04819 disassociated. External IP: 172.27.3.209, port: 63851119-2409-4ad5-a740-0157c795436f.
Jun 01 11:15:50.153750 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Calling delete_port for 63851119-2409-4ad5-a740-0157c795436f owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:50.165913 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fbaadc2d-2f6c-4bcd-8f80-f4ce1a44feb2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:50.202694 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fbaadc2d-2f6c-4bcd-8f80-f4ce1a44feb2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:50.338370 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fbaadc2d-2f6c-4bcd-8f80-f4ce1a44feb2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:50.351683 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d56b7be6-6acb-4b76-9c1e-b9ff8317cf09 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:50.424281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbaadc2d-2f6c-4bcd-8f80-f4ce1a44feb2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=581186f3-2036-4adf-9115-5da7004d9246,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:50.432229 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fbaadc2d-2f6c-4bcd-8f80-f4ce1a44feb2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:50.479140 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-fbaadc2d-2f6c-4bcd-8f80-f4ce1a44feb2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:50.480283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-fbaadc2d-2f6c-4bcd-8f80-f4ce1a44feb2 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/581186f3-2036-4adf-9115-5da7004d9246 HTTP/1.1" status: 204  len: 168 time: 0.4752250
Jun 01 11:15:50.488926 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:50.489583 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:50.499697 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-18b4cd92-8886-4f26-aae0-fc3324b47937 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:50.552900 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event deleted for resources: {'Port': ['ID=63851119-2409-4ad5-a740-0157c795436f,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:50.559508 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:50.569258 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b93ffb65-cdcb-497d-bbae-d702f45a8d3c req-d8025bc0-d939-4799-b896-bc3175f07cff tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:50.570728 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b93ffb65-cdcb-497d-bbae-d702f45a8d3c req-d8025bc0-d939-4799-b896-bc3175f07cff tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 946 time: 0.3016133
Jun 01 11:15:50.667367 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09325a59-fa84-4e9b-ab8a-27ed77b9fbbf req-1ecb5e11-5a72-4e91-85d5-45f27f8fef5c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:50.667965 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-09325a59-fa84-4e9b-ab8a-27ed77b9fbbf req-1ecb5e11-5a72-4e91-85d5-45f27f8fef5c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Synchronizing usage tracker for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:15:50.674336 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:50.712611 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:15:50.715501 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4f67df3-2d69-43b1-828f-063f25374345" -d '{"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-unplugged", "status": "completed", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:15:50.726434 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:50.731908 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:50.735116 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:50.805999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-09325a59-fa84-4e9b-ab8a-27ed77b9fbbf req-1ecb5e11-5a72-4e91-85d5-45f27f8fef5c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Unset dirty status for tenant:22a029b4c9f84f4191259891ac3af6c3 on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:15:50.807396 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-09325a59-fa84-4e9b-ab8a-27ed77b9fbbf req-1ecb5e11-5a72-4e91-85d5-45f27f8fef5c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/ports?device_id=98a71b50-c504-4fff-86f4-d4d54cee7e31 HTTP/1.1" status: 200  len: 946 time: 0.4700706
Jun 01 11:15:50.814833 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37878) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:50.822743 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=8']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:50.824359 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b93ffb65-cdcb-497d-bbae-d702f45a8d3c req-55b427db-4430-415a-9470-0fca2a2487ae tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1885040
Jun 01 11:15:50.826875 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:50.887208 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-09325a59-fa84-4e9b-ab8a-27ed77b9fbbf req-1088940b-e547-408f-b435-4aa8f9b6ab7e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups?id=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0661962
Jun 01 11:15:50.894353 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Router abf03e4b-fdd0-44b3-86be-277da7892b4a has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:15:50.940639 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 01 Jun 2021 11:15:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6bd5a166-1996-40e3-8d55-2fe1b2b2b941 x-openstack-request-id: req-6bd5a166-1996-40e3-8d55-2fe1b2b2b941 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:15:50.940941 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-unplugged", "status": "failed", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c", "code": 422}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:15:50.941209 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-6bd5a166-1996-40e3-8d55-2fe1b2b2b941 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:15:50.941651 dv-cinder-787764-3-iscsi neutron-server[119242]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'code': 422} returned with failed status
Jun 01 11:15:51.003634 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-7cf38017-54f0-48c7-b701-48bffc5775f3 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1864517
Jun 01 11:15:51.212911 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:15:51.224335 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] Sync routers for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:15:51.236355 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:15:51.237266 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57980de430>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:15:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:51.297378 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] No DVR routers for this DVR port 63851119-2409-4ad5-a740-0157c795436f on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:15:51.300242 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:51.302332 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c94b2b1-4bb2-4eca-af23-8a207b599bef req-2b9f9e56-2040-4a49-9434-0349f8c113d0 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.79 "DELETE /v2.0/ports/63851119-2409-4ad5-a740-0157c795436f HTTP/1.1" status: 204  len: 173 time: 1.7867644
Jun 01 11:15:51.302942 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'name': 'network-vif-deleted', 'tag': '63851119-2409-4ad5-a740-0157c795436f'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:15:51.305457 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d2ba4e4b-3347-4d66-a02e-a3fd2b172163" -d '{"events": [{"server_uuid": "98a71b50-c504-4fff-86f4-d4d54cee7e31", "name": "network-vif-deleted", "tag": "63851119-2409-4ad5-a740-0157c795436f"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:15:51.364671 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:15:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdf062f4-93b6-4387-94a5-5a2af6460320 x-openstack-request-id: req-cdf062f4-93b6-4387-94a5-5a2af6460320 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:15:51.365231 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98a71b50-c504-4fff-86f4-d4d54cee7e31", "name": "network-vif-deleted", "tag": "63851119-2409-4ad5-a740-0157c795436f", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:15:51.365732 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-cdf062f4-93b6-4387-94a5-5a2af6460320 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:15:51.366378 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98a71b50-c504-4fff-86f4-d4d54cee7e31', 'name': 'network-vif-deleted', 'tag': '63851119-2409-4ad5-a740-0157c795436f', 'status': 'completed', 'code': 200}
Jun 01 11:15:51.478407 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:15:51.829590 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57980de430>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:51.835040 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] Checking router: abf03e4b-fdd0-44b3-86be-277da7892b4a for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:15:51.851199 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:15:51.851914 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57980de430>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:15:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:52.062811 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37952) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:52.067172 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3fa173-5e64-4342-a379-175d7bedf567 req-e0e74aa1-2846-47d1-8d70-66dbb3a32016 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:52.074609 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6b3fa173-5e64-4342-a379-175d7bedf567 req-e0e74aa1-2846-47d1-8d70-66dbb3a32016 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.1077392
Jun 01 11:15:52.122450 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6b3fa173-5e64-4342-a379-175d7bedf567 req-3d080738-348e-4330-84d9-e783a135deb0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0462878
Jun 01 11:15:52.126300 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:15:52.141511 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9c059957-3f23-4b6f-a230-ffd671b6a4c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:52.175486 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9c059957-3f23-4b6f-a230-ffd671b6a4c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:52.250679 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9c059957-3f23-4b6f-a230-ffd671b6a4c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:52.265244 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8b0ad6da-2793-48d0-8175-746093fd0c6a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:52.277208 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c059957-3f23-4b6f-a230-ffd671b6a4c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed060348-6e4d-4c2d-9b6a-e9000cba2c4a,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:52.288222 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9c059957-3f23-4b6f-a230-ffd671b6a4c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:52.316422 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9c059957-3f23-4b6f-a230-ffd671b6a4c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:52.322048 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-9c059957-3f23-4b6f-a230-ffd671b6a4c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "DELETE /v2.0/security-groups/ed060348-6e4d-4c2d-9b6a-e9000cba2c4a HTTP/1.1" status: 204  len: 168 time: 0.2558544
Jun 01 11:15:52.322417 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 37960) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:52.343657 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-94b5d032-b1f5-4250-973b-9561ecb35258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:52.345670 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-94b5d032-b1f5-4250-973b-9561ecb35258 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197&tenant_id=c004520781bb4854b87284b73cc2a8be HTTP/1.1" status: 200  len: 1097 time: 0.1132407
Jun 01 11:15:52.360431 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.api.v2.resource [None req-256b613b-4f63-49a8-a4a6-438626b5cdf7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] show failed (client error): The resource could not be found.
Jun 01 11:15:52.361878 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-256b613b-4f63-49a8-a4a6-438626b5cdf7 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "GET /v2.0/security-groups/ed060348-6e4d-4c2d-9b6a-e9000cba2c4a HTTP/1.1" status: 404  len: 347 time: 0.0381613
Jun 01 11:15:52.364810 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 37964) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:52.518704 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57980de430>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:15:52.522751 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f31ff1c-36db-4e72-b174-516b6ddf7549 None None] The sync data for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi is: [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:09:08Z', 'revision_number': 4, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'd5daee11-02d5-400a-872b-52ebf2382ec6', 'name': '', 'network_id': '418faffe-faca-4025-ab0f-56771435263e', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'mac_address': 'fa:16:3e:34:9a:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:04Z', 'updated_at': '2021-06-01T11:09:17Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'subnets': [{'id': '08c4a15d-0d06-4d4b-909f-10ac28c5c16c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:15:52.653844 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-9c7be8ec-a4ae-4df8-8fc7-baf5f093dbf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:52.655294 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-9c7be8ec-a4ae-4df8-8fc7-baf5f093dbf9 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 1097 time: 0.2154195
Jun 01 11:15:52.688847 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Deleting port e6a6d71a-700c-438c-aef2-425209572d36 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:52.689203 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:52.718768 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-f399587e-5755-4fc9-ba84-c53a6560a057 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:52.790247 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24fbefae-5506-470c-a1cf-7a17f82d68f6 None None] New status for floating IP 8e5712a1-35b2-4f01-a2cc-543cbca04819: DOWN {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:15:52.900918 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-c83640d3-887a-4ade-95ba-cc16195c933c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:52.902348 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-c83640d3-887a-4ade-95ba-cc16195c933c service neutron] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 917 time: 0.2398133
Jun 01 11:15:52.903958 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:52.904277 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:53.091878 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Calling delete_port for e6a6d71a-700c-438c-aef2-425209572d36 owned by network:floatingip {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:53.131733 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-e36fddde-8d25-4b4c-8a06-c1427a941235 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c HTTP/1.1" status: 200  len: 1000 time: 0.2202280
Jun 01 11:15:53.214077 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-3ec27188-0b67-40e8-845b-325f1ff4278c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:53.215684 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-3ec27188-0b67-40e8-845b-325f1ff4278c service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.0752239
Jun 01 11:15:53.483219 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:53.487922 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-515eabc3-3c55-4ea9-bc3e-e99ee9d02d0f tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:53.537712 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Pushing event deleted for resources: {'Port': ['ID=e6a6d71a-700c-438c-aef2-425209572d36,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:53.542634 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:15:53.586498 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-10f44344-51de-499d-bbe0-7584e4ebbccd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:53.588015 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-10f44344-51de-499d-bbe0-7584e4ebbccd service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3655043
Jun 01 11:15:53.625024 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c9b4025-afb8-44a2-b94f-5a5965f85f7f req-cd467784-6b75-42b9-a323-e4ef0dd80551 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:53.626499 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8c9b4025-afb8-44a2-b94f-5a5965f85f7f req-cd467784-6b75-42b9-a323-e4ef0dd80551 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.3444095
Jun 01 11:15:53.767131 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks [] for floatingip, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:53.776605 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8c9b4025-afb8-44a2-b94f-5a5965f85f7f req-f80bab52-e429-4555-963d-2c120c0f68c6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1256235
Jun 01 11:15:53.826031 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-edafe604-7191-46c2-9de4-adde23a329d7 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1958878
Jun 01 11:15:53.827426 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:53.828479 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] 10.222.0.74 "DELETE /v2.0/floatingips/8e5712a1-35b2-4f01-a2cc-543cbca04819 HTTP/1.1" status: 204  len: 168 time: 1.4626153
Jun 01 11:15:53.969163 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-092646ad-6d15-4f27-b771-0d5f9f2d1496 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1332285
Jun 01 11:15:54.491277 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 63851119-2409-4ad5-a740-0157c795436f no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:15:54.532002 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 63851119-2409-4ad5-a740-0157c795436f {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:15:54.532623 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 63851119-2409-4ad5-a740-0157c795436f not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:15:54.979675 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26ef878e-4420-4a09-b3c5-6b96eb48afff req-b5238f86-5acb-4471-8df9-f9a6b05ab31c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:54.981823 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-26ef878e-4420-4a09-b3c5-6b96eb48afff req-b5238f86-5acb-4471-8df9-f9a6b05ab31c tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0873101
Jun 01 11:15:55.032093 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-26ef878e-4420-4a09-b3c5-6b96eb48afff req-64822494-5a3c-45da-8624-e47cd67d13ba tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0439537
Jun 01 11:15:55.254437 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e0435026-62b5-4179-bb37-33d79685f091 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:55.326003 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:56.236013 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0f8d42-05dd-45df-a4de-cd14396b85f8 req-cdf7875f-732b-4787-ba98-22f1c000d58a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:56.237536 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba0f8d42-05dd-45df-a4de-cd14396b85f8 req-cdf7875f-732b-4787-ba98-22f1c000d58a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0909204
Jun 01 11:15:56.287023 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba0f8d42-05dd-45df-a4de-cd14396b85f8 req-99011348-d613-4e13-a02b-dc7ab845ca13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0424643
Jun 01 11:15:56.402035 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:57.478219 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6d62edf-efc4-4362-89e0-6607d4913148 req-c3a1b452-412a-41d4-81fc-8701051cb536 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:57.479753 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6d62edf-efc4-4362-89e0-6607d4913148 req-c3a1b452-412a-41d4-81fc-8701051cb536 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0802505
Jun 01 11:15:57.526738 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c6d62edf-efc4-4362-89e0-6607d4913148 req-780bd6c4-f19e-47af-83d3-20276229c6c9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408566
Jun 01 11:15:57.745999 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:58.033298 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38050) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:15:58.785920 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5ffed0-0e93-411f-92f0-abe420168ec0 req-0a8b9fc0-c030-4085-a135-8494ca2151b8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:15:58.791053 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd5ffed0-0e93-411f-92f0-abe420168ec0 req-0a8b9fc0-c030-4085-a135-8494ca2151b8 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.1295764
Jun 01 11:15:58.817001 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-926124'] for router_interface, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:58.849035 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cd5ffed0-0e93-411f-92f0-abe420168ec0 req-dea177df-2138-4c8c-aaf3-06e474108914 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0515513
Jun 01 11:15:59.266106 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Deleting port d5daee11-02d5-400a-872b-52ebf2382ec6 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:15:59.266678 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:59.489312 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] For port d5daee11-02d5-400a-872b-52ebf2382ec6, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=d5daee11-02d5-400a-872b-52ebf2382ec6,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:15:59.489654 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:59.618098 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Calling delete_port for d5daee11-02d5-400a-872b-52ebf2382ec6 owned by network:router_interface {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:15:59.791624 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:15:59.795519 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-bcfe169c-71fd-42ed-9115-48ca031052c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:15:59.839273 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Pushing event deleted for resources: {'Port': ['ID=d5daee11-02d5-400a-872b-52ebf2382ec6,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:15:59.842392 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:00.092651 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c43ec1-a822-41e4-8d06-1affc9b655a6 req-e363ca16-4277-4e0d-a55f-6b115e7c5abd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:00.094434 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c5c43ec1-a822-41e4-8d06-1affc9b655a6 req-e363ca16-4277-4e0d-a55f-6b115e7c5abd tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.1187685
Jun 01 11:16:00.163859 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c5c43ec1-a822-41e4-8d06-1affc9b655a6 req-a522239c-fb95-4a11-a95a-75d40cb9326d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0615678
Jun 01 11:16:00.193810 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-776947', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-646716'] for router_interface, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:00.584163 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Router abf03e4b-fdd0-44b3-86be-277da7892b4a has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:16:00.765474 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:16:00.773722 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] Sync routers for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:16:00.777802 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] 10.222.0.74 "PUT /v2.0/routers/abf03e4b-fdd0-44b3-86be-277da7892b4a/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7434084
Jun 01 11:16:00.780779 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38064) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:00.783457 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:16:00.784137 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5792f66670>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:15:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:01.057167 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:16:01.068036 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks [] for router, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:01.254765 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:01.356392 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Deleting port 8624cb8b-76b9-4f90-a661-444f15de47ab {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:16:01.356729 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:01.458605 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5792f66670>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245'}], 'enable_snat': True}, 'gw_port_id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:15:59Z', 'revision_number': 5, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port': {'id': '8624cb8b-76b9-4f90-a661-444f15de47ab', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:b7:02:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:52Z', 'updated_at': '2021-06-01T11:09:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:01.474784 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] Checking router: abf03e4b-fdd0-44b3-86be-277da7892b4a for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:16:01.489964 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] Routers {'abf03e4b-fdd0-44b3-86be-277da7892b4a'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:16:01.491136 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5792f66670>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:15:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['abf03e4b-fdd0-44b3-86be-277da7892b4a'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:01.500246 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] For port 8624cb8b-76b9-4f90-a661-444f15de47ab, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=8624cb8b-76b9-4f90-a661-444f15de47ab,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:16:01.500610 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:01.531736 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c6aa17-7348-4d3c-a3e6-f2cda202e8b3 req-420c31a4-e9a9-484f-9857-5d5293a0d4dc tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:01.534027 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41c6aa17-7348-4d3c-a3e6-f2cda202e8b3 req-420c31a4-e9a9-484f-9857-5d5293a0d4dc tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.1373317
Jun 01 11:16:01.632233 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Calling delete_port for 8624cb8b-76b9-4f90-a661-444f15de47ab owned by network:router_gateway {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:16:01.668747 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] Set router abf03e4b-fdd0-44b3-86be-277da7892b4a gateway port host: None {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:16:01.670792 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41c6aa17-7348-4d3c-a3e6-f2cda202e8b3 req-0609cad9-6a0d-47c4-be4e-0f299d037c0f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1035886
Jun 01 11:16:01.802992 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5792f66670>, [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:16:01Z', 'revision_number': 6, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port_host': None}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:01.807478 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea28c580-9331-47d9-9d89-d15cc8545f59 None None] The sync data for ids ['abf03e4b-fdd0-44b3-86be-277da7892b4a'] in dv-cinder-787764-3-iscsi is: [{'id': 'abf03e4b-fdd0-44b3-86be-277da7892b4a', 'name': 'tempest-AttachVolumeTestJSON-959695017-router', 'tenant_id': '22a029b4c9f84f4191259891ac3af6c3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:50Z', 'updated_at': '2021-06-01T11:16:01Z', 'revision_number': 6, 'project_id': '22a029b4c9f84f4191259891ac3af6c3', 'gw_port_host': None}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:16:01.810864 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:01.821757 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:01.879549 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Pushing event deleted for resources: {'Port': ['ID=8624cb8b-76b9-4f90-a661-444f15de47ab,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:01.882587 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:01.973863 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-645297'] for router_gateway, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:02.152036 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-643132', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4050'] for router, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:02.155145 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:02.183752 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-643584'] for router, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:02.184502 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Fanout notify agent at l3_agent the message router_deleted on router abf03e4b-fdd0-44b3-86be-277da7892b4a {{(pid=119240) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 11:16:02.203528 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:02.207139 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e3d61987-69ea-46ee-b91f-466f9a17fa4f admin admin] 10.222.0.74 "DELETE /v2.0/routers/abf03e4b-fdd0-44b3-86be-277da7892b4a HTTP/1.1" status: 204  len: 168 time: 1.4231319
Jun 01 11:16:02.207541 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38074) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:02.281257 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_v2 [None req-bcfddc71-6c30-4f13-bdd2-2af3db2a41ea admin admin] Deleting subnet 08c4a15d-0d06-4d4b-909f-10ac28c5c16c {{(pid=119241) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:16:02.285252 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bcfddc71-6c30-4f13-bdd2-2af3db2a41ea admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:02.342151 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bcfddc71-6c30-4f13-bdd2-2af3db2a41ea admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10844045'] for subnet, precommit_delete_associations {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:02.480249 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bcfddc71-6c30-4f13-bdd2-2af3db2a41ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:02.648245 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 8624cb8b-76b9-4f90-a661-444f15de47ab no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:16:02.691245 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 8624cb8b-76b9-4f90-a661-444f15de47ab {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:16:02.691245 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 8624cb8b-76b9-4f90-a661-444f15de47ab not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:16:02.691245 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device d5daee11-02d5-400a-872b-52ebf2382ec6 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:16:02.754081 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: d5daee11-02d5-400a-872b-52ebf2382ec6 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:16:02.754081 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device d5daee11-02d5-400a-872b-52ebf2382ec6 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:16:02.800038 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bcfddc71-6c30-4f13-bdd2-2af3db2a41ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10882836', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10623430'] for subnet, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:02.812453 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:02.854508 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75cc93e0-1886-44b2-8d1b-57b2174f097e None None] Network 418faffe-faca-4025-ab0f-56771435263e requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:16:02.971780 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcfddc71-6c30-4f13-bdd2-2af3db2a41ea admin admin] Pushing event deleted for resources: {'Subnet': ['ID=08c4a15d-0d06-4d4b-909f-10ac28c5c16c,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:02.976508 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-bcfddc71-6c30-4f13-bdd2-2af3db2a41ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:02.977566 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bcfddc71-6c30-4f13-bdd2-2af3db2a41ea admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:03.020939 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-bcfddc71-6c30-4f13-bdd2-2af3db2a41ea admin admin] 10.222.0.74 "DELETE /v2.0/subnets/08c4a15d-0d06-4d4b-909f-10ac28c5c16c HTTP/1.1" status: 204  len: 168 time: 0.8121421
Jun 01 11:16:03.023719 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38082) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:03.126385 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4504c6b-1e79-4973-9966-de3478f576d9 req-5e315850-019b-4dc7-bfd4-e5d12ae7c4f9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:03.142060 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a4504c6b-1e79-4973-9966-de3478f576d9 req-5e315850-019b-4dc7-bfd4-e5d12ae7c4f9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.2940240
Jun 01 11:16:03.223033 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:03.240153 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a4504c6b-1e79-4973-9966-de3478f576d9 req-3f378cb0-b4e2-44fd-a0d0-782a4c4fb554 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0963275
Jun 01 11:16:03.252182 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] DHCP port deletion for 418faffe-faca-4025-ab0f-56771435263e request from dv-cinder-787764-3-iscsi {{(pid=119242) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 11:16:03.355817 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Deleting port 27b19c3f-289e-417b-a07e-63b061c293a3 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:16:03.356514 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:03.357826 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] Deleting port 27b19c3f-289e-417b-a07e-63b061c293a3 {{(pid=119242) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:16:03.358212 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:03.477025 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] For port 27b19c3f-289e-417b-a07e-63b061c293a3, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=27b19c3f-289e-417b-a07e-63b061c293a3,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:16:03.477398 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:03.485301 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] For port 27b19c3f-289e-417b-a07e-63b061c293a3, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=27b19c3f-289e-417b-a07e-63b061c293a3,segment=NetworkSegment(f42fc69f-20da-4605-91d9-46f05e1a6b0a),segment_id=f42fc69f-20da-4605-91d9-46f05e1a6b0a)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:16:03.485545 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:03.684075 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] Calling delete_port for 27b19c3f-289e-417b-a07e-63b061c293a3 owned by network:dhcp {{(pid=119242) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:16:03.742327 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676'] for port, after_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:03.746329 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:03.751062 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Calling delete_port for 27b19c3f-289e-417b-a07e-63b061c293a3 owned by network:dhcp {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:16:03.793078 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] Pushing event deleted for resources: {'Port': ['ID=27b19c3f-289e-417b-a07e-63b061c293a3,revision_number=None']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:03.797887 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:03.805542 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] No DVR routers for this DVR port 27b19c3f-289e-417b-a07e-63b061c293a3 on host dv-cinder-787764-3-iscsi {{(pid=119242) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:16:03.817979 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:03.821952 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-1649b3b6-78cf-4a28-990a-4fe64aa884d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:03.867717 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Pushing event deleted for resources: {'Port': ['ID=27b19c3f-289e-417b-a07e-63b061c293a3,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:03.870840 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:03.871742 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] No DVR routers for this DVR port 27b19c3f-289e-417b-a07e-63b061c293a3 on host dv-cinder-787764-3-iscsi {{(pid=119240) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:16:03.993721 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.007686 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f579290e9a0>,) {'filters': {'network_id': ['418faffe-faca-4025-ab0f-56771435263e']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:04.022720 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f579290e9a0>, 'f42fc69f-20da-4605-91d9-46f05e1a6b0a') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:04.023056 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f579290e9a0>, 'f42fc69f-20da-4605-91d9-46f05e1a6b0a') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:04.035326 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.052897 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.058879 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Releasing vlan 695 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:16:04.059263 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   util.warn(
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   util.warn(
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   util.warn(
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   util.warn(
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:16:04.072998 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:16:04.155200 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.162322 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7646bead-3183-469b-b419-b9dc677687ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:04.175825 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.187377 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Pushing event deleted for resources: {'Network': ['ID=418faffe-faca-4025-ab0f-56771435263e,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:04.197818 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.198202 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.198633 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.199018 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.199468 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.199865 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.200253 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.200782 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.201204 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.201564 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.201921 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.202277 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:04.211214 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:04.218235 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] 10.222.0.74 "DELETE /v2.0/networks/418faffe-faca-4025-ab0f-56771435263e HTTP/1.1" status: 204  len: 168 time: 1.1927142
Jun 01 11:16:04.369231 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38096) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:04.421642 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-fdec6caf-7372-4578-b73a-2658f1b1556e admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=22a029b4c9f84f4191259891ac3af6c3&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0511110
Jun 01 11:16:04.424822 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38100) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:04.466362 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c3a234-c0f5-44ca-bcc8-c0586b5845fd req-a552812a-c1d0-4fd4-a368-fa3df81017e7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:04.468604 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f0c3a234-c0f5-44ca-bcc8-c0586b5845fd req-a552812a-c1d0-4fd4-a368-fa3df81017e7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0938165
Jun 01 11:16:04.521684 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 27b19c3f-289e-417b-a07e-63b061c293a3 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:16:04.530385 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-346dd73d-574f-4cee-b6e2-064606443ff9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.541952 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f0c3a234-c0f5-44ca-bcc8-c0586b5845fd req-9d9f03f6-e0e3-46da-9531-4757b5d022d0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0581160
Jun 01 11:16:04.559176 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 27b19c3f-289e-417b-a07e-63b061c293a3 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:16:04.559848 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 27b19c3f-289e-417b-a07e-63b061c293a3 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:16:04.560078 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-346dd73d-574f-4cee-b6e2-064606443ff9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.623906 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-346dd73d-574f-4cee-b6e2-064606443ff9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.629726 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-55d8b498-0077-4c82-9046-329640fae254 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:04.645834 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-346dd73d-574f-4cee-b6e2-064606443ff9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c081aed-861d-474e-ac3b-be9b71026d8d,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:04.649851 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-346dd73d-574f-4cee-b6e2-064606443ff9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:04.653075 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-346dd73d-574f-4cee-b6e2-064606443ff9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:04.654720 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-346dd73d-574f-4cee-b6e2-064606443ff9 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/3c081aed-861d-474e-ac3b-be9b71026d8d HTTP/1.1" status: 204  len: 168 time: 0.2288501
Jun 01 11:16:05.785772 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b09b22e9-c3f7-4459-a287-599e70f46e91 req-fa9abdd8-445d-4d65-aadc-bad8d5dd4837 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:05.787533 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b09b22e9-c3f7-4459-a287-599e70f46e91 req-fa9abdd8-445d-4d65-aadc-bad8d5dd4837 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.1159043
Jun 01 11:16:05.837883 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b09b22e9-c3f7-4459-a287-599e70f46e91 req-e61e88c5-5dad-4b41-8c3c-4cd72981fb9b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435607
Jun 01 11:16:06.192480 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38172) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:06.305471 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:06.320707 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:06.324463 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Usage tracker for resource:security_group_rule and tenant:32883e3d3e594bbd9d14a6da942f935b is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:06.327214 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:06.332829 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:06.412807 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:06.416514 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:06.423662 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-c7386c14-3dfd-4055-9449-17e7e95259b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:06.465682 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d36537dc-77c1-4c59-a0e2-61bdc2f36c15,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:06.469853 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=32883e3d3e594bbd9d14a6da942f935b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2763941
Jun 01 11:16:06.470755 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:06.472380 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38178) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:06.530335 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-159942a4-8ad1-4b65-ac39-81337d22d5a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:06.555526 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-159942a4-8ad1-4b65-ac39-81337d22d5a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:06.605334 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-159942a4-8ad1-4b65-ac39-81337d22d5a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:06.609742 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9a17fe33-6269-4655-8275-0ded703b9f6b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:06.620141 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159942a4-8ad1-4b65-ac39-81337d22d5a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d36537dc-77c1-4c59-a0e2-61bdc2f36c15,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:06.623952 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-159942a4-8ad1-4b65-ac39-81337d22d5a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:06.627059 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-159942a4-8ad1-4b65-ac39-81337d22d5a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:06.631218 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-159942a4-8ad1-4b65-ac39-81337d22d5a2 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/d36537dc-77c1-4c59-a0e2-61bdc2f36c15 HTTP/1.1" status: 204  len: 168 time: 0.1575110
Jun 01 11:16:07.034008 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88319477-1d42-4794-b222-c016124d6380 req-f9dadaf8-5f2e-482d-9872-1e73829a394d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:07.035501 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-88319477-1d42-4794-b222-c016124d6380 req-f9dadaf8-5f2e-482d-9872-1e73829a394d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0862255
Jun 01 11:16:07.086121 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-88319477-1d42-4794-b222-c016124d6380 req-32572402-a5db-431c-8b69-805a8dbaa9c3 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406625
Jun 01 11:16:08.274142 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928a2425-d803-42a9-8cf0-e9352032bcfc req-55d12d50-4b37-434a-88f2-e89176629d19 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:08.275553 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-928a2425-d803-42a9-8cf0-e9352032bcfc req-55d12d50-4b37-434a-88f2-e89176629d19 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0788374
Jun 01 11:16:08.324563 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-928a2425-d803-42a9-8cf0-e9352032bcfc req-96250a60-9b10-45d4-9a36-c098a1e760c9 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429156
Jun 01 11:16:09.509950 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea723a8-2af1-4737-b8e1-40d3672538b7 req-21311ef1-51e2-4084-a1bc-3933c28feed0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:09.511397 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6ea723a8-2af1-4737-b8e1-40d3672538b7 req-21311ef1-51e2-4084-a1bc-3933c28feed0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0793495
Jun 01 11:16:09.558396 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6ea723a8-2af1-4737-b8e1-40d3672538b7 req-d28cd5a6-194f-4baf-99da-523eb1b3c667 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411749
Jun 01 11:16:10.595694 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:16:10.737859 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:16:10.751868 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'port_id': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'mac_address': 'fa:16:3e:dc:95:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:16:10.752259 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2861d67-04cc-4ce9-a179-a8c365955b0e req-f2c5a605-5a9f-4f24-b81b-68008d0a9f75 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:10.753741 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d2861d67-04cc-4ce9-a179-a8c365955b0e req-f2c5a605-5a9f-4f24-b81b-68008d0a9f75 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 944 time: 0.0881140
Jun 01 11:16:10.800174 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d2861d67-04cc-4ce9-a179-a8c365955b0e req-b62a5e2c-9db4-4056-a7e8-a97331944c5e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404811
Jun 01 11:16:10.807810 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:10.825953 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:16:10.841905 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:16:10.845592 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:10.847292 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-4e2b3929-d640-4f6c-857e-2ec49fd025aa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:10.916935 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=9']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:10.924617 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.925272 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.925620 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.925968 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.926443 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.926843 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.927244 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.927580 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.927934 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.928263 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.928701 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.929026 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:10.933469 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:11.049791 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:16:11.788680 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-c9b4bd42-04e3-44b8-bafe-37bfeec017e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:11.790165 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-c9b4bd42-04e3-44b8-bafe-37bfeec017e7 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c004520781bb4854b87284b73cc2a8be&device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 1098 time: 0.0707133
Jun 01 11:16:11.998912 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-e1c249c9-6da1-410e-99be-a16b4332c28b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:12.000406 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-e1c249c9-6da1-410e-99be-a16b4332c28b service neutron] 10.222.0.79 "GET /v2.0/networks?id=ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 200  len: 917 time: 0.1898727
Jun 01 11:16:12.111631 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0979563-918a-4f70-8387-a87dae9632bb req-adc3b778-df80-4144-b379-9189576d29e6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:12.113081 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a0979563-918a-4f70-8387-a87dae9632bb req-adc3b778-df80-4144-b379-9189576d29e6 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 945 time: 0.1909823
Jun 01 11:16:12.119488 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-7d2d018f-814d-4121-bb10-4659ea3f9038 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c HTTP/1.1" status: 200  len: 1001 time: 0.1121008
Jun 01 11:16:12.203328 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a0979563-918a-4f70-8387-a87dae9632bb req-4a9acda3-81f4-4d1b-9bb2-33e86c578c9d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0828838
Jun 01 11:16:12.210326 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-b07499c8-2e4f-4505-b584-582332dc2545 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:12.211686 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-b07499c8-2e4f-4505-b584-582332dc2545 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 200  len: 855 time: 0.0780568
Jun 01 11:16:12.289634 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-1fd69e6d-661e-46c8-ab2d-24a659511a5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:12.291139 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-1fd69e6d-661e-46c8-ab2d-24a659511a5a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ce8e721a-c529-4460-882f-9261a0c7ceed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0730669
Jun 01 11:16:12.420320 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-c659958b-94f2-467b-9d4a-cc95d37c9fbf service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1218948
Jun 01 11:16:12.549337 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-83b3b12e-f274-4818-91ee-c5e2d6a5c990 req-ba7093c1-f80e-40a6-ac7c-80cc33b74402 service neutron] 10.222.0.79 "GET /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1225059
Jun 01 11:16:12.592812 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:16:12.661965 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:16:12.662340 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:12.782545 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:12.813813 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:16:12.816177 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-55b1d6a8-c813-4415-9c90-81f5fb588436" -d '{"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-plugged", "status": "completed", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:16:12.824458 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:16:12.828487 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:12.831927 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:12.868106 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:16:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86ac7e6c-7e91-4e9a-8779-c86e6069b72e x-openstack-request-id: req-86ac7e6c-7e91-4e9a-8779-c86e6069b72e {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:16:12.868434 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-plugged", "status": "completed", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:16:12.868534 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-86ac7e6c-7e91-4e9a-8779-c86e6069b72e {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:16:12.868924 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'code': 200}
Jun 01 11:16:12.919149 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=10']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:12.922484 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:13.055858 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38298) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:13.188146 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:13.203285 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:13.207306 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Usage tracker for resource:security_group_rule and tenant:9171854b16fe46e7b805af2a44eef8e0 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:13.210772 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:13.218266 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:13.219599 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a0c2d7-8e56-434a-b428-8ee55024b3e6 req-b7f99ff7-d036-4bc2-b71d-387ad875d65c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:13.221082 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f4a0c2d7-8e56-434a-b428-8ee55024b3e6 req-b7f99ff7-d036-4bc2-b71d-387ad875d65c service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 1100 time: 0.0721803
Jun 01 11:16:13.265544 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f4a0c2d7-8e56-434a-b428-8ee55024b3e6 req-f864ea50-36e4-442d-adb7-d5040a5e30c9 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382428
Jun 01 11:16:13.310934 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:13.315446 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:13.328323 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-75532810-9a3d-4c5e-aebb-489775103f33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:13.368304 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f6741d2b-b8b8-4400-ae4b-70da8d6caac9,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:13.372954 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:13.375734 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=9171854b16fe46e7b805af2a44eef8e0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3187675
Jun 01 11:16:13.378781 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38308) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:13.461824 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9ff9607a-1e9a-433a-840f-447c1a3e8ff9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:13.490073 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9ff9607a-1e9a-433a-840f-447c1a3e8ff9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:13.528716 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbe3108-f91a-40af-921b-0e74ea403031 req-aa76db3a-4258-4cc2-ad53-97cb34a7f952 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:13.530323 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1fbe3108-f91a-40af-921b-0e74ea403031 req-aa76db3a-4258-4cc2-ad53-97cb34a7f952 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 947 time: 0.1951866
Jun 01 11:16:13.545795 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9ff9607a-1e9a-433a-840f-447c1a3e8ff9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:13.551436 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-eb6fcb1f-a7d0-4bb7-a175-e34561926fa1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:13.565335 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ff9607a-1e9a-433a-840f-447c1a3e8ff9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6741d2b-b8b8-4400-ae4b-70da8d6caac9,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:13.568400 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9ff9607a-1e9a-433a-840f-447c1a3e8ff9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:13.570760 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9ff9607a-1e9a-433a-840f-447c1a3e8ff9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:13.572128 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-9ff9607a-1e9a-433a-840f-447c1a3e8ff9 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/f6741d2b-b8b8-4400-ae4b-70da8d6caac9 HTTP/1.1" status: 204  len: 168 time: 0.1911569
Jun 01 11:16:13.584136 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1fbe3108-f91a-40af-921b-0e74ea403031 req-0173dcb9-8d2f-4daa-aa42-747b4287927b tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0474744
Jun 01 11:16:13.878720 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38318) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:13.897487 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:13.912769 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:13.916694 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] Usage tracker for resource:security_group_rule and tenant:17a267f6bf584cd3a17b12714acb41b4 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:13.920021 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:13.926057 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:14.014987 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:14.018672 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:14.025160 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9c059957-3f23-4b6f-a230-ffd671b6a4c3 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:14.066834 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=17a267f6bf584cd3a17b12714acb41b4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1870346
Jun 01 11:16:14.067625 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c2fdbc5-5b59-4144-a454-eef6c47208ee,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:14.070329 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38322) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:14.070568 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b517bb8a-f8d4-423c-b87d-7131415f5ce1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:14.130516 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-73d03975-d53e-409d-93d7-db7547536057 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:14.155720 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-73d03975-d53e-409d-93d7-db7547536057 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:14.207950 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-73d03975-d53e-409d-93d7-db7547536057 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:14.211445 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-49173d14-f89f-4985-a08d-c997afada860 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:14.222603 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d03975-d53e-409d-93d7-db7547536057 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c2fdbc5-5b59-4144-a454-eef6c47208ee,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:14.225521 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-73d03975-d53e-409d-93d7-db7547536057 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:14.232418 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-73d03975-d53e-409d-93d7-db7547536057 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:14.233515 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-73d03975-d53e-409d-93d7-db7547536057 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/1c2fdbc5-5b59-4144-a454-eef6c47208ee HTTP/1.1" status: 204  len: 168 time: 0.1617267
Jun 01 11:16:14.784389 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c70a88-dd06-488e-a34b-257739731c58 req-d34e6a2f-7276-4b48-aeae-5073129b36f0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:14.785886 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a7c70a88-dd06-488e-a34b-257739731c58 req-d34e6a2f-7276-4b48-aeae-5073129b36f0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 947 time: 0.0826046
Jun 01 11:16:14.808416 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:16:14.832441 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a7c70a88-dd06-488e-a34b-257739731c58 req-869bf375-1781-4be7-b66c-416af961bd8d tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406189
Jun 01 11:16:16.035399 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a83ce78b-abb4-496b-87bd-5c7123b87ff8 req-9d9262ac-0b9b-4164-bc39-34046a66bdb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:16.037044 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a83ce78b-abb4-496b-87bd-5c7123b87ff8 req-9d9262ac-0b9b-4164-bc39-34046a66bdb7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 947 time: 0.0919142
Jun 01 11:16:16.038969 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38386) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:16.083821 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a83ce78b-abb4-496b-87bd-5c7123b87ff8 req-88c51047-a4cd-42fb-8a70-b46f630d1bb3 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389047
Jun 01 11:16:16.157065 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.170796 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:16.174571 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Usage tracker for resource:security_group_rule and tenant:075bc450f3ca4966bbecca0f8a1e836a is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:16.177441 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:16.183129 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:16.263245 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.267026 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.274996 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f011b52b-28be-429c-ab9e-4cd0e8ad00e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:16.315678 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=075bc450f3ca4966bbecca0f8a1e836a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2757199
Jun 01 11:16:16.317741 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4966206a-4d1b-42c3-b30a-e075301b8a91,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:16.318833 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38392) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:16.321281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:16.377266 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ccd2ca24-147e-46f6-95f9-4c4a31d83a0b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.402470 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ccd2ca24-147e-46f6-95f9-4c4a31d83a0b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.452646 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ccd2ca24-147e-46f6-95f9-4c4a31d83a0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.456430 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-476e2663-7aee-4794-960c-c6df6e5a2625 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:16.468176 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd2ca24-147e-46f6-95f9-4c4a31d83a0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4966206a-4d1b-42c3-b30a-e075301b8a91,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:16.470661 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ccd2ca24-147e-46f6-95f9-4c4a31d83a0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:16.478338 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ccd2ca24-147e-46f6-95f9-4c4a31d83a0b admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.481583 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-ccd2ca24-147e-46f6-95f9-4c4a31d83a0b admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/4966206a-4d1b-42c3-b30a-e075301b8a91 HTTP/1.1" status: 204  len: 168 time: 0.1594050
Jun 01 11:16:16.639689 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.758783 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38402) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:16.779751 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.794999 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:16.799140 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Usage tracker for resource:security_group_rule and tenant:584b4451a6b249fd978ba5061ae10917 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:16.802138 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:16.808377 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:16.899479 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.904005 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:16.912605 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6278c12c-c72b-4942-8fca-99749ea40920 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:16.955552 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=584b4451a6b249fd978ba5061ae10917&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1956668
Jun 01 11:16:16.956495 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bcb5858-ca99-40ba-8bd9-f5b9c09e1dd8,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:16.958195 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38406) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:16.959666 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:17.020132 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-72aa59e2-98aa-410c-8740-8262bbc87a8c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:17.048267 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-72aa59e2-98aa-410c-8740-8262bbc87a8c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:17.101175 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-72aa59e2-98aa-410c-8740-8262bbc87a8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:17.105068 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fb6c6f42-4705-4f20-bd14-858654aaefd8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:17.120175 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72aa59e2-98aa-410c-8740-8262bbc87a8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bcb5858-ca99-40ba-8bd9-f5b9c09e1dd8,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:17.122849 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-72aa59e2-98aa-410c-8740-8262bbc87a8c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:17.130876 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-72aa59e2-98aa-410c-8740-8262bbc87a8c admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:17.132230 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-72aa59e2-98aa-410c-8740-8262bbc87a8c admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/4bcb5858-ca99-40ba-8bd9-f5b9c09e1dd8 HTTP/1.1" status: 204  len: 168 time: 0.1730585
Jun 01 11:16:17.326329 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1de8e1c-7dda-4658-91a1-979d66f84dd0 req-bbfb9fb7-24a2-43f6-aca3-0dbcdcc3dcf5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:17.328033 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c1de8e1c-7dda-4658-91a1-979d66f84dd0 req-bbfb9fb7-24a2-43f6-aca3-0dbcdcc3dcf5 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 947 time: 0.0977874
Jun 01 11:16:17.375770 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c1de8e1c-7dda-4658-91a1-979d66f84dd0 req-e18af76b-b4ec-47a1-b982-2d384a45a176 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412977
Jun 01 11:16:18.566489 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef19061f-6f19-4083-93ef-b8a65100fdf0 req-ea61220c-a04c-4517-846e-4811967b8c7f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:18.567973 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ef19061f-6f19-4083-93ef-b8a65100fdf0 req-ea61220c-a04c-4517-846e-4811967b8c7f tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 947 time: 0.0806775
Jun 01 11:16:18.612104 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ef19061f-6f19-4083-93ef-b8a65100fdf0 req-6e767bdd-c608-4600-865c-7ec66ba33faf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385463
Jun 01 11:16:19.395210 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38534) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:19.508646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:19.522816 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:19.526754 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] Usage tracker for resource:security_group_rule and tenant:a9593cbcb48a4027a49b47e76bd80a30 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:19.530053 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:19.535691 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:19.623168 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:19.627123 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:19.633575 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d8aef0b9-64d2-4646-bee3-f200d43102ea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:19.675895 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e3c5fb3-1760-4412-a54d-c900bb75b244,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:19.680170 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=a9593cbcb48a4027a49b47e76bd80a30&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2838330
Jun 01 11:16:19.681034 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-248c3a10-5018-481a-b1b0-700fdfb1670b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:19.683216 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38540) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:19.739915 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cd6dc24e-2f64-4890-b6db-55456ed2019d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:19.765308 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cd6dc24e-2f64-4890-b6db-55456ed2019d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:19.815355 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cd6dc24e-2f64-4890-b6db-55456ed2019d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:19.818898 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-72ad4672-fa96-48af-9a8b-f3d2f69cbaea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:19.830075 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd6dc24e-2f64-4890-b6db-55456ed2019d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e3c5fb3-1760-4412-a54d-c900bb75b244,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:19.833807 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cd6dc24e-2f64-4890-b6db-55456ed2019d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:19.837108 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-cd6dc24e-2f64-4890-b6db-55456ed2019d admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:19.838037 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-cd6dc24e-2f64-4890-b6db-55456ed2019d admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/8e3c5fb3-1760-4412-a54d-c900bb75b244 HTTP/1.1" status: 204  len: 168 time: 0.1544316
Jun 01 11:16:20.110131 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38548) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:20.128325 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:20.142912 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:20.146649 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Usage tracker for resource:security_group_rule and tenant:5178fe00a1d946289c63f81230d710f2 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:20.149384 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:20.155065 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:20.236968 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:20.241234 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:20.250359 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-91f6abcd-6284-4339-ae5a-b4a781e75206 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:20.292852 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=5178fe00a1d946289c63f81230d710f2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1816521
Jun 01 11:16:20.295326 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38556) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:20.298225 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=918b21fa-0894-4709-b6a8-ab33754617e1,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:20.310952 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:20.360081 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cd4bf758-4460-4e9f-8ba8-8e7da567ca33 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:20.386535 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cd4bf758-4460-4e9f-8ba8-8e7da567ca33 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:20.440038 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cd4bf758-4460-4e9f-8ba8-8e7da567ca33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:20.444769 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e12b91c3-dc0d-4d01-a630-b62b9919e53f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:20.456533 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd4bf758-4460-4e9f-8ba8-8e7da567ca33 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=918b21fa-0894-4709-b6a8-ab33754617e1,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:20.459958 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-cd4bf758-4460-4e9f-8ba8-8e7da567ca33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:20.465226 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cd4bf758-4460-4e9f-8ba8-8e7da567ca33 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:20.466341 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-cd4bf758-4460-4e9f-8ba8-8e7da567ca33 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/918b21fa-0894-4709-b6a8-ab33754617e1 HTTP/1.1" status: 204  len: 168 time: 0.1700761
Jun 01 11:16:21.588660 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38596) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:21.707746 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:21.721841 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:21.725720 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Usage tracker for resource:security_group_rule and tenant:6ce158544de94172af538eeeb31d0fe4 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:21.728536 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:21.735077 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:21.821149 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:21.825762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:21.837687 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-57acfee7-0aa2-479e-a927-b29edd1a8d9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:21.877624 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=6ce158544de94172af538eeeb31d0fe4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2877386
Jun 01 11:16:21.878479 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=933c98d8-12a5-464b-aec6-23c68ce6af83,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:21.880485 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38602) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:21.881522 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:21.942870 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-55b0018f-b035-4505-93de-5c83e6ede0ce admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:21.967548 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-55b0018f-b035-4505-93de-5c83e6ede0ce admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:22.017612 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-55b0018f-b035-4505-93de-5c83e6ede0ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:22.021189 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0d9155a8-7c60-41be-b846-38aaa411f25b tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:22.032072 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b0018f-b035-4505-93de-5c83e6ede0ce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=933c98d8-12a5-464b-aec6-23c68ce6af83,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:22.035571 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-55b0018f-b035-4505-93de-5c83e6ede0ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:22.038699 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-55b0018f-b035-4505-93de-5c83e6ede0ce admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:22.039835 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-55b0018f-b035-4505-93de-5c83e6ede0ce admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/933c98d8-12a5-464b-aec6-23c68ce6af83 HTTP/1.1" status: 204  len: 168 time: 0.1583543
Jun 01 11:16:22.708450 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-cf702b9c-f48e-49e8-a15f-ea974adaf829 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:22.959540 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38636) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:23.081614 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:23.096068 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:23.099893 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] Usage tracker for resource:security_group_rule and tenant:aab415dc2f6d4fd89183f03dce12e4fc is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:23.102793 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:23.108456 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:23.192198 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:23.196249 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:23.205476 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2e7aabc3-53c9-4b1c-ac5b-c97f3c804ae0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:23.248135 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=aab415dc2f6d4fd89183f03dce12e4fc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2873509
Jun 01 11:16:23.249794 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ecf1cbd-c92f-480c-9944-ae00a5ac0099,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:23.251079 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38650) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:23.252739 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f97a1767-be50-4a27-b656-e27da6f99add admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:23.312540 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b7747b29-7ff1-4ea6-a96f-13facf61350e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:23.338349 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b7747b29-7ff1-4ea6-a96f-13facf61350e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:23.392859 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b7747b29-7ff1-4ea6-a96f-13facf61350e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:23.397824 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-487c85a7-a0a3-417a-bc93-9191f166aefc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:23.410082 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7747b29-7ff1-4ea6-a96f-13facf61350e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ecf1cbd-c92f-480c-9944-ae00a5ac0099,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:23.413864 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b7747b29-7ff1-4ea6-a96f-13facf61350e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:23.419218 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-b7747b29-7ff1-4ea6-a96f-13facf61350e admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:23.420359 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-b7747b29-7ff1-4ea6-a96f-13facf61350e admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/3ecf1cbd-c92f-480c-9944-ae00a5ac0099 HTTP/1.1" status: 204  len: 168 time: 0.1679385
Jun 01 11:16:25.246530 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e67fd45b-f0a4-40ee-9bd7-407e3ebc18aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:25.319780 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:26.403009 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:27.745763 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:31.340354 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38742) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:31.455382 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:31.469556 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:31.473365 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Usage tracker for resource:security_group_rule and tenant:6c0fd356aae044eb9180d6a2b322cda7 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:31.476317 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:31.482179 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:31.568318 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:31.572033 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:31.579386 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-cd4bf758-4460-4e9f-8ba8-8e7da567ca33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:31.617856 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac4ccb0f-08bd-4286-8051-30f75a0d2d3f,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:31.622634 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=6c0fd356aae044eb9180d6a2b322cda7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2807171
Jun 01 11:16:31.623608 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:31.625314 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38748) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:31.682248 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-333d3a36-7e11-4f29-b931-c9c6ac5c4214 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:31.708252 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-333d3a36-7e11-4f29-b931-c9c6ac5c4214 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:31.759609 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-333d3a36-7e11-4f29-b931-c9c6ac5c4214 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:31.764651 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-43924780-d08d-4c59-82ba-a5a0da5448a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:31.776136 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-333d3a36-7e11-4f29-b931-c9c6ac5c4214 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac4ccb0f-08bd-4286-8051-30f75a0d2d3f,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:31.778436 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-333d3a36-7e11-4f29-b931-c9c6ac5c4214 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:31.782681 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-333d3a36-7e11-4f29-b931-c9c6ac5c4214 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:31.784107 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-333d3a36-7e11-4f29-b931-c9c6ac5c4214 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/ac4ccb0f-08bd-4286-8051-30f75a0d2d3f HTTP/1.1" status: 204  len: 168 time: 0.1579018
Jun 01 11:16:32.055481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38756) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:32.073733 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.087788 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:32.092092 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] Usage tracker for resource:security_group_rule and tenant:4cf3d0a6234942948cd545ac28c4c546 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:32.094871 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:32.100680 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:32.182146 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.186827 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.195082 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c493cda7-b693-4ca6-b2ef-37d4a42c0e4b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:32.233574 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=4cf3d0a6234942948cd545ac28c4c546&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1770334
Jun 01 11:16:32.235157 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0190b4ca-3c19-40ae-8ab4-0f67c4458def,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:32.236213 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38760) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:32.238199 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f52158d6-4c11-4c54-8627-f45b3e79ad8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:32.374236 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5e70f3fe-e280-42d5-bd5d-7b0257332ea6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.399545 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5e70f3fe-e280-42d5-bd5d-7b0257332ea6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.450783 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5e70f3fe-e280-42d5-bd5d-7b0257332ea6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.454490 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6edb4c45-f628-469f-bb59-1bc637e5033e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:32.465375 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e70f3fe-e280-42d5-bd5d-7b0257332ea6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0190b4ca-3c19-40ae-8ab4-0f67c4458def,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:32.470357 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5e70f3fe-e280-42d5-bd5d-7b0257332ea6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:32.472318 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5e70f3fe-e280-42d5-bd5d-7b0257332ea6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.473418 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5e70f3fe-e280-42d5-bd5d-7b0257332ea6 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/0190b4ca-3c19-40ae-8ab4-0f67c4458def HTTP/1.1" status: 204  len: 168 time: 0.2362213
Jun 01 11:16:32.812535 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38768) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:32.830433 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.844541 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:32.848304 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] Usage tracker for resource:security_group_rule and tenant:d347a1e33ea54965a6db3fb0fad890f9 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:32.851050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:32.856683 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:32.940969 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.944616 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:32.951960 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f53ada18-e726-4330-91dd-700390610e21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:32.995878 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=d347a1e33ea54965a6db3fb0fad890f9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1822653
Jun 01 11:16:32.996791 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fec2ec21-575c-41eb-b171-358d972dd119,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:32.998745 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38772) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:32.999860 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-40ed5e9f-89a5-46e1-aecb-2f902d48954f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:33.057101 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4fd20240-96a0-4879-87c7-8a9e0d34a8a4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:33.081589 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4fd20240-96a0-4879-87c7-8a9e0d34a8a4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:33.135863 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4fd20240-96a0-4879-87c7-8a9e0d34a8a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:33.140339 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-718b7b29-3357-4b46-a92e-86b5d1df10d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:33.154662 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fd20240-96a0-4879-87c7-8a9e0d34a8a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fec2ec21-575c-41eb-b171-358d972dd119,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:33.157390 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4fd20240-96a0-4879-87c7-8a9e0d34a8a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:33.166831 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-4fd20240-96a0-4879-87c7-8a9e0d34a8a4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:33.167986 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-4fd20240-96a0-4879-87c7-8a9e0d34a8a4 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/fec2ec21-575c-41eb-b171-358d972dd119 HTTP/1.1" status: 204  len: 168 time: 0.1681917
Jun 01 11:16:34.279754 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 38804) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:34.393740 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:34.408312 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:16:34.412120 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] Usage tracker for resource:security_group_rule and tenant:40814f1aa24c48bb881e401b501839ac is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:16:34.414890 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:16:34.421208 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:16:34.502645 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:34.506280 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:34.514567 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-1ab69c1f-ade2-4a28-bf95-b87178eba107 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:34.553381 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=40814f1aa24c48bb881e401b501839ac&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2725182
Jun 01 11:16:34.554865 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26596233-37ab-440e-a9de-a680fd9afcaf,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:34.556230 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38810) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:34.557944 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-bbca9ccb-c524-44ca-9d59-74e175754202 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:34.615402 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7f8a9d78-7ee8-4694-bfd7-9b7849b6f889 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:34.640812 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7f8a9d78-7ee8-4694-bfd7-9b7849b6f889 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:34.690803 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7f8a9d78-7ee8-4694-bfd7-9b7849b6f889 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:34.694562 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e397c969-039b-4d71-9b5d-e6cb10ebf235 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:34.709754 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8a9d78-7ee8-4694-bfd7-9b7849b6f889 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26596233-37ab-440e-a9de-a680fd9afcaf,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:34.712667 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7f8a9d78-7ee8-4694-bfd7-9b7849b6f889 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:34.717460 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7f8a9d78-7ee8-4694-bfd7-9b7849b6f889 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:34.718568 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7f8a9d78-7ee8-4694-bfd7-9b7849b6f889 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/26596233-37ab-440e-a9de-a680fd9afcaf HTTP/1.1" status: 204  len: 168 time: 0.1606712
Jun 01 11:16:46.651506 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:51.775235 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49aac629-9a76-475e-8073-1c44f65892ff req-5960a7cc-7471-475c-a065-d0895be0f92a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:51.776702 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-49aac629-9a76-475e-8073-1c44f65892ff req-5960a7cc-7471-475c-a065-d0895be0f92a tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 947 time: 0.0833180
Jun 01 11:16:51.807295 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:16:51.820610 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-49aac629-9a76-475e-8073-1c44f65892ff req-85cc70d0-572a-4708-b4fe-e2cad5867ec7 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0378075
Jun 01 11:16:52.700323 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ad7083fc-fbfa-4e4e-a588-bd8f56f13643 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:53.071919 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-55173d2f-6a78-4b99-ac28-b2627db65d00 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:53.073449 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-55173d2f-6a78-4b99-ac28-b2627db65d00 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 947 time: 0.1398008
Jun 01 11:16:53.084454 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3758cc0-1754-4471-a09f-269faf23489b req-fc53fcf3-12d2-47d6-8d99-0e8b0d10fd5e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:16:53.085793 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d3758cc0-1754-4471-a09f-269faf23489b req-fc53fcf3-12d2-47d6-8d99-0e8b0d10fd5e tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 947 time: 0.1211679
Jun 01 11:16:53.293761 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d3758cc0-1754-4471-a09f-269faf23489b req-88446978-0d23-4281-8af2-6c31bce8c298 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups?id=62d034d5-70ed-4a77-95de-b54bea075ef8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1766040
Jun 01 11:16:53.329667 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Deleting port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:16:53.330009 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:53.459946 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] For port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:16:53.460302 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:53.743345 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:53.743746 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:53.744062 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Floating IP ac54c94f-1206-4501-9784-16f54659a2a1 disassociated. External IP: 172.27.3.237, port: e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c.
Jun 01 11:16:53.744403 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Calling delete_port for e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:16:53.854051 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:53.859828 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-14482782-2501-4783-9550-7944b42e6963 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:53.904212 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event deleted for resources: {'Port': ['ID=e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:53.915900 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.916276 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.916928 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.916928 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.917337 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.917672 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.918024 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.918372 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.918750 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.919098 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.919443 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.919808 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:16:53.972638 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:54.098260 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Router 27b3b506-6634-49e2-b666-8f59cfd9cf96 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:16:54.277511 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:16:54.286847 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] Sync routers for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:16:54.296949 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:16:54.297578 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798216a30>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:16:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:54.351400 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] No DVR routers for this DVR port e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:16:54.354343 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:54.357905 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-deleted', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:16:54.360370 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd70b67b-a8cb-4b14-abfe-f4063a7b93ae" -d '{"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-deleted", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:16:54.384833 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8eece8c0-5fae-4baf-b2ed-d01a7826f94a req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.79 "DELETE /v2.0/ports/e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c HTTP/1.1" status: 204  len: 173 time: 1.2980521
Jun 01 11:16:54.417796 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:16:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b3bd626-3da4-46df-9966-0d75d4f9668e x-openstack-request-id: req-2b3bd626-3da4-46df-9966-0d75d4f9668e {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:16:54.418109 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b1c180-827f-4aff-80d4-d9bf7e192197", "name": "network-vif-deleted", "tag": "e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:16:54.418408 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-2b3bd626-3da4-46df-9966-0d75d4f9668e {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:16:54.419624 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b1c180-827f-4aff-80d4-d9bf7e192197', 'name': 'network-vif-deleted', 'tag': 'e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c', 'status': 'completed', 'code': 200}
Jun 01 11:16:54.484585 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-4b23e86c-ac7d-433e-a905-eab80bc2c592 req-9d43f0f1-c04a-4a86-8e55-f8eb98987055 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Synchronizing usage tracker for tenant:c004520781bb4854b87284b73cc2a8be on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:16:54.501454 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-4b23e86c-ac7d-433e-a905-eab80bc2c592 req-9d43f0f1-c04a-4a86-8e55-f8eb98987055 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Unset dirty status for tenant:c004520781bb4854b87284b73cc2a8be on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:16:54.502583 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4b23e86c-ac7d-433e-a905-eab80bc2c592 req-9d43f0f1-c04a-4a86-8e55-f8eb98987055 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/ports?device_id=43b1c180-827f-4aff-80d4-d9bf7e192197 HTTP/1.1" status: 200  len: 210 time: 0.0666885
Jun 01 11:16:54.523069 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:16:54.840261 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798216a30>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:54.844401 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] Checking router: 27b3b506-6634-49e2-b666-8f59cfd9cf96 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:16:54.852372 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:16:54.852951 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798216a30>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:16:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:55.024552 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:16:55.249394 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c9751a14-1c4a-4bb0-96bc-5561e4afc11c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:55.323118 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:55.333894 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798216a30>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:16:55.337872 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45606e0-a458-4c6c-9d54-9ec71be63e17 None None] The sync data for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi is: [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:09:04Z', 'revision_number': 4, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'edb1a8b5-7020-4904-83c6-aafe25fb115f', 'name': '', 'network_id': 'ce8e721a-c529-4460-882f-9261a0c7ceed', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'mac_address': 'fa:16:3e:73:a9:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:09:01Z', 'updated_at': '2021-06-01T11:09:19Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'subnets': [{'id': '79a8ddfd-a675-47e5-9921-33f71f58d781', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:16:55.540126 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6994112-682e-4af0-9165-521fa6186018 None None] New status for floating IP ac54c94f-1206-4501-9784-16f54659a2a1: DOWN {{(pid=119242) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:16:55.629648 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38844) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:55.698480 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-90925e5a-3404-40ce-a4cf-187b58a69e13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:55.727547 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-90925e5a-3404-40ce-a4cf-187b58a69e13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:55.784647 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-90925e5a-3404-40ce-a4cf-187b58a69e13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:55.788631 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-159942a4-8ad1-4b65-ac39-81337d22d5a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:55.803802 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90925e5a-3404-40ce-a4cf-187b58a69e13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=62d034d5-70ed-4a77-95de-b54bea075ef8,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:55.806797 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-90925e5a-3404-40ce-a4cf-187b58a69e13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:55.814603 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-90925e5a-3404-40ce-a4cf-187b58a69e13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:55.815754 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-90925e5a-3404-40ce-a4cf-187b58a69e13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "DELETE /v2.0/security-groups/62d034d5-70ed-4a77-95de-b54bea075ef8 HTTP/1.1" status: 204  len: 168 time: 0.1849921
Jun 01 11:16:55.818517 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38848) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:55.835039 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.api.v2.resource [None req-8f571a0e-53b7-45ba-bda1-57a061af8b25 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] show failed (client error): The resource could not be found.
Jun 01 11:16:55.836041 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-8f571a0e-53b7-45ba-bda1-57a061af8b25 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "GET /v2.0/security-groups/62d034d5-70ed-4a77-95de-b54bea075ef8 HTTP/1.1" status: 404  len: 347 time: 0.0166361
Jun 01 11:16:55.838817 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38852) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:16:56.050455 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Deleting port 649c7ab7-343d-4623-859e-ea2a9af5e3ac {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:16:56.050684 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:56.165925 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:56.166272 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:56.286107 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Calling delete_port for 649c7ab7-343d-4623-859e-ea2a9af5e3ac owned by network:floatingip {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:16:56.404212 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:56.407449 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:56.408075 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:16:56.449188 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Pushing event deleted for resources: {'Port': ['ID=649c7ab7-343d-4623-859e-ea2a9af5e3ac,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:16:56.452244 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:16:56.544505 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks [] for floatingip, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:56.561811 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:56.562938 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-43510704-9acb-4757-b085-80f319736ac0 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] 10.222.0.74 "DELETE /v2.0/floatingips/ac54c94f-1206-4501-9784-16f54659a2a1 HTTP/1.1" status: 204  len: 168 time: 0.7232530
Jun 01 11:16:56.775698 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:16:56.847752 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:16:56.848108 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device e98ac2eb-4cb2-47bb-b5a1-c2b907b3e49c not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:16:57.747835 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:16:59.334556 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38876) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:00.120208 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-926124'] for router_interface, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:00.522075 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Deleting port edb1a8b5-7020-4904-83c6-aafe25fb115f {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:17:00.522739 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:00.641595 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] For port edb1a8b5-7020-4904-83c6-aafe25fb115f, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=edb1a8b5-7020-4904-83c6-aafe25fb115f,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:17:00.641947 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:00.768244 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Calling delete_port for edb1a8b5-7020-4904-83c6-aafe25fb115f owned by network:router_interface {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:17:00.910743 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:00.915029 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-e4398980-a0db-4b61-84db-31bc6410b8b9 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:00.960265 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Pushing event deleted for resources: {'Port': ['ID=edb1a8b5-7020-4904-83c6-aafe25fb115f,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:00.963350 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:01.229792 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-776947', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-646716'] for router_interface, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:01.676988 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Router 27b3b506-6634-49e2-b666-8f59cfd9cf96 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:17:01.853347 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:17:01.862306 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] Sync routers for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:17:01.866311 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] 10.222.0.74 "PUT /v2.0/routers/27b3b506-6634-49e2-b666-8f59cfd9cf96/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5307009
Jun 01 11:17:01.868879 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38882) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:01.871356 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:17:01.871999 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798172af0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:16:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:17:02.044557 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks [] for router, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:02.047365 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:17:02.218644 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:02.289422 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Deleting port 361ec9aa-775c-4942-9aac-a9385710054a {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:17:02.289762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:02.349202 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798172af0>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46'}], 'enable_snat': True}, 'gw_port_id': '361ec9aa-775c-4942-9aac-a9385710054a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:17:00Z', 'revision_number': 5, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port': {'id': '361ec9aa-775c-4942-9aac-a9385710054a', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:eb:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:08:51Z', 'updated_at': '2021-06-01T11:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:17:02.352933 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] Checking router: 27b3b506-6634-49e2-b666-8f59cfd9cf96 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:17:02.361790 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] Routers {'27b3b506-6634-49e2-b666-8f59cfd9cf96'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:17:02.362392 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798172af0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:16:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['27b3b506-6634-49e2-b666-8f59cfd9cf96'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:17:02.409829 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] For port 361ec9aa-775c-4942-9aac-a9385710054a, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=361ec9aa-775c-4942-9aac-a9385710054a,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:17:02.410180 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:02.515206 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] Set router 27b3b506-6634-49e2-b666-8f59cfd9cf96 gateway port host: None {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:17:02.535694 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Calling delete_port for 361ec9aa-775c-4942-9aac-a9385710054a owned by network:router_gateway {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:17:02.619194 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798172af0>, [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:17:02Z', 'revision_number': 6, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port_host': None}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:17:02.623050 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af82180-9568-458f-91c6-9274b8218c5b None None] The sync data for ids ['27b3b506-6634-49e2-b666-8f59cfd9cf96'] in dv-cinder-787764-3-iscsi is: [{'id': '27b3b506-6634-49e2-b666-8f59cfd9cf96', 'name': 'tempest-AttachVolumeShelveTestJSON-328178639-router', 'tenant_id': 'c004520781bb4854b87284b73cc2a8be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:08:49Z', 'updated_at': '2021-06-01T11:17:02Z', 'revision_number': 6, 'project_id': 'c004520781bb4854b87284b73cc2a8be', 'gw_port_host': None}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:17:02.668899 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:02.672387 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-41151d36-7bce-4c29-98aa-af55b22b3aee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:02.813735 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Pushing event deleted for resources: {'Port': ['ID=361ec9aa-775c-4942-9aac-a9385710054a,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:02.816944 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:02.901591 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-645297'] for router_gateway, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.076910 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-643132', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4050'] for router, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.078372 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.100986 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-643584'] for router, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.101533 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Fanout notify agent at l3_agent the message router_deleted on router 27b3b506-6634-49e2-b666-8f59cfd9cf96 {{(pid=119240) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 11:17:03.114861 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.116004 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-20e21892-a6c4-40a4-ae7f-5817c0c42dec admin admin] 10.222.0.74 "DELETE /v2.0/routers/27b3b506-6634-49e2-b666-8f59cfd9cf96 HTTP/1.1" status: 204  len: 168 time: 1.2462249
Jun 01 11:17:03.118468 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38886) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:03.179031 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-0070b9cf-5760-4c04-83ad-5cc1de222777 admin admin] Deleting subnet 79a8ddfd-a675-47e5-9921-33f71f58d781 {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:17:03.181956 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0070b9cf-5760-4c04-83ad-5cc1de222777 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.229738 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0070b9cf-5760-4c04-83ad-5cc1de222777 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10700501'] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.310456 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0070b9cf-5760-4c04-83ad-5cc1de222777 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.562269 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0070b9cf-5760-4c04-83ad-5cc1de222777 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10700437', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-11313305'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.567385 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-542fb74f-5ad3-4a23-936d-9c29845f6f99 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:03.607209 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0070b9cf-5760-4c04-83ad-5cc1de222777 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=79a8ddfd-a675-47e5-9921-33f71f58d781,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:03.609242 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-0070b9cf-5760-4c04-83ad-5cc1de222777 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.613050 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0070b9cf-5760-4c04-83ad-5cc1de222777 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:03.615843 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-0070b9cf-5760-4c04-83ad-5cc1de222777 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/79a8ddfd-a675-47e5-9921-33f71f58d781 HTTP/1.1" status: 204  len: 168 time: 0.4964151
Jun 01 11:17:03.617048 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06bdbc83-7313-4906-abec-953f13d884e3 None None] Network ce8e721a-c529-4460-882f-9261a0c7ceed requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:17:03.618508 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38890) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:03.727141 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.805442 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Deleting port df5a5bab-5537-41fd-af8f-50c6c78af549 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:17:03.805781 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.872634 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] DHCP port deletion for ce8e721a-c529-4460-882f-9261a0c7ceed request from dv-cinder-787764-3-iscsi {{(pid=119242) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 11:17:03.907850 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] For port df5a5bab-5537-41fd-af8f-50c6c78af549, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=df5a5bab-5537-41fd-af8f-50c6c78af549,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:17:03.908448 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:03.939698 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] Deleting port df5a5bab-5537-41fd-af8f-50c6c78af549 {{(pid=119242) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:17:03.940079 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.031163 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Calling delete_port for df5a5bab-5537-41fd-af8f-50c6c78af549 owned by network:dhcp {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:17:04.034980 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] For port df5a5bab-5537-41fd-af8f-50c6c78af549, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=df5a5bab-5537-41fd-af8f-50c6c78af549,segment=NetworkSegment(218ec5cc-bc49-4575-bae0-d28b11abe976),segment_id=218ec5cc-bc49-4575-bae0-d28b11abe976)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:17:04.035400 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.079434 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.083143 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-6213378c-9660-4436-84d1-fcc7c64b9283 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:04.127897 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Pushing event deleted for resources: {'Port': ['ID=df5a5bab-5537-41fd-af8f-50c6c78af549,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:04.131335 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:04.135252 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] No DVR routers for this DVR port df5a5bab-5537-41fd-af8f-50c6c78af549 on host dv-cinder-787764-3-iscsi {{(pid=119240) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:17:04.163527 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] Calling delete_port for df5a5bab-5537-41fd-af8f-50c6c78af549 owned by network:dhcp {{(pid=119242) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:17:04.205808 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676'] for port, after_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.209271 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:04.253248 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] Pushing event deleted for resources: {'Port': ['ID=df5a5bab-5537-41fd-af8f-50c6c78af549,revision_number=None']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:04.255098 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] No DVR routers for this DVR port df5a5bab-5537-41fd-af8f-50c6c78af549 on host dv-cinder-787764-3-iscsi {{(pid=119242) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:17:04.256512 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:04.346142 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.359344 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f57981557c0>,) {'filters': {'network_id': ['ce8e721a-c529-4460-882f-9261a0c7ceed']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:17:04.371107 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f57981557c0>, '218ec5cc-bc49-4575-bae0-d28b11abe976') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:17:04.371405 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f57981557c0>, '218ec5cc-bc49-4575-bae0-d28b11abe976') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:17:04.382435 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.398297 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.404767 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Releasing vlan 687 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:17:04.405143 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:17:04.418069 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:17:04.494331 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.498041 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a34b12ef-adec-40d4-a5db-03fd0311325f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:04.514935 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.524937 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Pushing event deleted for resources: {'Network': ['ID=ce8e721a-c529-4460-882f-9261a0c7ceed,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:04.533642 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device edb1a8b5-7020-4904-83c6-aafe25fb115f no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:17:04.536682 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.537062 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.537437 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.537800 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.538235 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.538667 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.539059 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.539413 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.539795 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.540149 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.540501 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.540849 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:04.544717 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:04.555407 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-ea89ebc0-eee9-47f6-9fec-f2570b4547f0 admin admin] 10.222.0.74 "DELETE /v2.0/networks/ce8e721a-c529-4460-882f-9261a0c7ceed HTTP/1.1" status: 204  len: 168 time: 0.9336212
Jun 01 11:17:04.572434 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: edb1a8b5-7020-4904-83c6-aafe25fb115f {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:17:04.572795 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device edb1a8b5-7020-4904-83c6-aafe25fb115f not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:17:04.573222 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device df5a5bab-5537-41fd-af8f-50c6c78af549 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:17:04.606101 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: df5a5bab-5537-41fd-af8f-50c6c78af549 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:17:04.606883 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device df5a5bab-5537-41fd-af8f-50c6c78af549 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:17:04.607308 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 361ec9aa-775c-4942-9aac-a9385710054a no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:17:04.640368 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 361ec9aa-775c-4942-9aac-a9385710054a {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:17:04.640981 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 361ec9aa-775c-4942-9aac-a9385710054a not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:17:04.670306 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38896) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:04.719214 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-151ed476-87ea-4614-9d97-7c2c85327516 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=c004520781bb4854b87284b73cc2a8be&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0476868
Jun 01 11:17:04.721640 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 38900) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:04.777188 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-29d38f08-0719-4416-8af6-6551bf0f8bdf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.802400 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-29d38f08-0719-4416-8af6-6551bf0f8bdf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.851744 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-29d38f08-0719-4416-8af6-6551bf0f8bdf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.855560 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-333d3a36-7e11-4f29-b931-c9c6ac5c4214 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:04.872756 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d38f08-0719-4416-8af6-6551bf0f8bdf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8a704f7-e3f1-4215-ac51-d3a0e86c39f4,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:04.876517 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-29d38f08-0719-4416-8af6-6551bf0f8bdf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:04.879734 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-29d38f08-0719-4416-8af6-6551bf0f8bdf admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:04.880831 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-29d38f08-0719-4416-8af6-6551bf0f8bdf admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/d8a704f7-e3f1-4215-ac51-d3a0e86c39f4 HTTP/1.1" status: 204  len: 168 time: 0.1583223
Jun 01 11:17:12.691546 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-41eeb148-ee88-4fc7-b429-9ce7f349dda8 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0693297
Jun 01 11:17:12.781435 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-daa9ca21-0de0-4c14-b75d-11d1cd25c4f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:12.782791 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-daa9ca21-0de0-4c14-b75d-11d1cd25c4f8 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1099 time: 0.0710282
Jun 01 11:17:12.924294 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-1b7e4591-a979-465e-91eb-dc18f3f2197e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:12.925722 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-1b7e4591-a979-465e-91eb-dc18f3f2197e service neutron] 10.222.0.79 "GET /v2.0/networks?id=a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 200  len: 910 time: 0.1246481
Jun 01 11:17:13.117725 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-0858ab29-2091-4138-9f8f-182214afd87b service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 200  len: 1002 time: 0.1851487
Jun 01 11:17:13.183550 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-9f733ae1-81e8-4c89-a46e-8e9d7e287e41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:13.185564 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-9f733ae1-81e8-4c89-a46e-8e9d7e287e41 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f490a491-e776-4472-a23c-46b7b609b438 HTTP/1.1" status: 200  len: 848 time: 0.0609119
Jun 01 11:17:13.259240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-79dfb1d9-3240-40fb-8008-b5c7afa53d68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:13.260698 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-79dfb1d9-3240-40fb-8008-b5c7afa53d68 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=a30966a5-dc46-445f-8d4a-d8da7c97fafd&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0689535
Jun 01 11:17:13.390430 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-cebfa2e7-76f4-40b7-a9c3-5f9781a72012 service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1222236
Jun 01 11:17:13.522822 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0e163248-6d99-4895-8a45-82f7bc18eac0 req-9ff21947-bfe4-4c08-a5b6-e1c77c32e4ee service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1256857
Jun 01 11:17:13.926918 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39008) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:14.041768 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:14.056331 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:17:14.060166 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] Usage tracker for resource:security_group_rule and tenant:d966102fb1e4434f87d22ce3694bf377 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:17:14.062928 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:17:14.068601 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:17:14.147607 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:14.151406 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:14.160076 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9f21ac22-a83d-4ea0-b8bb-7c782d541512 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:14.198899 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=d966102fb1e4434f87d22ce3694bf377&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2708888
Jun 01 11:17:14.199730 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aeb00dea-9f30-488b-9ea4-8fb378f2fbf3,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:14.202163 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39014) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:14.202926 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-948a65ff-f05e-4ce8-96e3-53a66b034b19 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:14.258738 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ff3e6166-cfb9-4fe2-a8ae-570a48c51792 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:14.288739 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ff3e6166-cfb9-4fe2-a8ae-570a48c51792 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:14.340848 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ff3e6166-cfb9-4fe2-a8ae-570a48c51792 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:14.344424 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fc3932f3-696c-42bb-a9f8-7adc2d1f1705 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:14.355075 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff3e6166-cfb9-4fe2-a8ae-570a48c51792 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aeb00dea-9f30-488b-9ea4-8fb378f2fbf3,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:14.358998 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-ff3e6166-cfb9-4fe2-a8ae-570a48c51792 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:14.362428 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ff3e6166-cfb9-4fe2-a8ae-570a48c51792 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:14.363164 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-ff3e6166-cfb9-4fe2-a8ae-570a48c51792 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/aeb00dea-9f30-488b-9ea4-8fb378f2fbf3 HTTP/1.1" status: 204  len: 168 time: 0.1600032
Jun 01 11:17:16.684818 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:22.704562 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ffc6d967-adbc-44f6-83b1-9f600edd471e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:25.251789 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-2177d2fc-96fc-46d4-9674-64ad06ad6e2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:25.329599 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:25.552773 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144e579c-f695-4872-9a53-4489f3e86457 req-c4212a48-c618-429d-a77c-97350ef724e6 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:25.554101 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-144e579c-f695-4872-9a53-4489f3e86457 req-c4212a48-c618-429d-a77c-97350ef724e6 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.0792015
Jun 01 11:17:25.597224 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-144e579c-f695-4872-9a53-4489f3e86457 req-4c7b8cc2-0e48-45de-a47f-1c12046c1ec2 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0374041
Jun 01 11:17:26.407500 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:26.789910 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b221acc7-5a19-4476-a540-e7fe3b9216dd req-4919d6e0-94dd-4e01-b045-dc16ed162544 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:26.791387 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b221acc7-5a19-4476-a540-e7fe3b9216dd req-4919d6e0-94dd-4e01-b045-dc16ed162544 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.0842459
Jun 01 11:17:26.834671 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b221acc7-5a19-4476-a540-e7fe3b9216dd req-2299e678-ea04-4a3b-8e59-172c0e94977c tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0370622
Jun 01 11:17:27.750769 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:28.017253 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8425a69-d591-4f36-b6ec-d1ffb2c36544 req-01be15fd-df38-4cc3-894c-7f866d094f83 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:28.018606 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b8425a69-d591-4f36-b6ec-d1ffb2c36544 req-01be15fd-df38-4cc3-894c-7f866d094f83 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.0789471
Jun 01 11:17:28.066026 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b8425a69-d591-4f36-b6ec-d1ffb2c36544 req-aa275784-ad8d-495f-836b-658080aa54ed tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418644
Jun 01 11:17:28.805301 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:17:29.251213 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8e422f-8198-4d54-9e6c-8f0a7fad0439 req-27d99aca-93f5-4b26-91fa-cd61aa870eb2 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:29.252721 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd8e422f-8198-4d54-9e6c-8f0a7fad0439 req-27d99aca-93f5-4b26-91fa-cd61aa870eb2 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.0842359
Jun 01 11:17:29.296815 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bd8e422f-8198-4d54-9e6c-8f0a7fad0439 req-59d1d9f4-1ff2-441b-b7d1-f112acb95584 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385387
Jun 01 11:17:32.139784 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39242) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:32.254382 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:32.275240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:17:32.281331 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Usage tracker for resource:security_group_rule and tenant:bc75ba82b99b454bb8db9c507671a878 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:17:32.284177 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:17:32.289866 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:17:32.371658 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:32.375864 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:32.387639 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-73d03975-d53e-409d-93d7-db7547536057 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:32.426499 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=bc75ba82b99b454bb8db9c507671a878&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2856653
Jun 01 11:17:32.427546 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfdb72ee-9e32-46db-8973-b457d12e4943,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:32.429239 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39248) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:32.431372 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:32.487230 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-52b47f6f-38cd-4941-b897-5b68f677b2dc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:32.517223 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-52b47f6f-38cd-4941-b897-5b68f677b2dc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:32.574356 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-52b47f6f-38cd-4941-b897-5b68f677b2dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:32.578279 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ccf9d00d-8ecb-4c8e-acf1-b10ec20d9f94 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:32.590315 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52b47f6f-38cd-4941-b897-5b68f677b2dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfdb72ee-9e32-46db-8973-b457d12e4943,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:32.593143 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-52b47f6f-38cd-4941-b897-5b68f677b2dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:32.600265 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-52b47f6f-38cd-4941-b897-5b68f677b2dc admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:32.604162 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-52b47f6f-38cd-4941-b897-5b68f677b2dc admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/dfdb72ee-9e32-46db-8973-b457d12e4943 HTTP/1.1" status: 204  len: 168 time: 0.1712539
Jun 01 11:17:32.875063 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39256) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:32.892789 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:32.907566 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:17:32.911362 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] Usage tracker for resource:security_group_rule and tenant:795dc5749114494c998d943ee48b08b8 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:17:32.914300 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:17:32.920789 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:17:33.000477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:33.004089 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:33.011010 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-a1b86a72-761b-4089-b388-5825b6444efb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:33.049503 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e773e8b-9ed7-4ba9-9389-ce3fc761ace9,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:33.053467 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=795dc5749114494c998d943ee48b08b8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1773963
Jun 01 11:17:33.054326 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-ca35f7f9-9b00-4d23-a132-92c697c8b4c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:33.056238 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39260) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:33.116768 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5a8cd530-c246-412a-9c34-07f21bfa6e59 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:33.141860 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5a8cd530-c246-412a-9c34-07f21bfa6e59 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:33.191036 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5a8cd530-c246-412a-9c34-07f21bfa6e59 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:33.195740 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7c5cc2fa-64e8-4f9c-9419-10f86af1cc56 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:33.208773 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a8cd530-c246-412a-9c34-07f21bfa6e59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e773e8b-9ed7-4ba9-9389-ce3fc761ace9,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:33.211033 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5a8cd530-c246-412a-9c34-07f21bfa6e59 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:33.219549 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5a8cd530-c246-412a-9c34-07f21bfa6e59 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:33.220686 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-5a8cd530-c246-412a-9c34-07f21bfa6e59 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/8e773e8b-9ed7-4ba9-9389-ce3fc761ace9 HTTP/1.1" status: 204  len: 168 time: 0.1635699
Jun 01 11:17:35.641487 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-a6688c24-a993-4093-a0ee-c8d1bbecd88c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:35.643236 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-a6688c24-a993-4093-a0ee-c8d1bbecd88c service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1099 time: 0.0758078
Jun 01 11:17:35.786698 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-845a9464-32fc-4286-beb3-765a551f23af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:35.788337 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-845a9464-32fc-4286-beb3-765a551f23af service neutron] 10.222.0.79 "GET /v2.0/networks?id=a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 200  len: 910 time: 0.1393526
Jun 01 11:17:35.904083 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-d4343eb1-38e2-4b75-a5df-2dc8797ff6e1 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 200  len: 1002 time: 0.1077261
Jun 01 11:17:35.973961 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-3e65119a-c9bd-42d7-b5f9-2f110949390d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:35.975410 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-3e65119a-c9bd-42d7-b5f9-2f110949390d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f490a491-e776-4472-a23c-46b7b609b438 HTTP/1.1" status: 200  len: 848 time: 0.0660677
Jun 01 11:17:36.138083 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-20c348d8-0be6-4227-9902-7ec5ba77849d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:17:36.140527 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-20c348d8-0be6-4227-9902-7ec5ba77849d service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=a30966a5-dc46-445f-8d4a-d8da7c97fafd&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1583555
Jun 01 11:17:36.273488 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-ef368ac6-808b-4314-9624-f1aa017e4848 service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1268916
Jun 01 11:17:36.409850 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-04449e73-15c8-475d-b4be-b10c037fbf40 req-a2375568-eba8-4c37-9f0c-26bcf23c112c service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1297891
Jun 01 11:17:36.489200 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39394) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:36.605151 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:36.619019 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:17:36.622957 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] Usage tracker for resource:security_group_rule and tenant:6657cb4be9a24838a726003e23defd45 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:17:36.626323 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:17:36.632342 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:17:36.714659 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:36.718299 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:36.726506 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-90925e5a-3404-40ce-a4cf-187b58a69e13 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:36.765271 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=6657cb4be9a24838a726003e23defd45&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2750254
Jun 01 11:17:36.766824 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42352276-170a-4380-b778-8138a239286f,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:36.767892 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39400) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:36.769819 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8f4b22ec-f505-4186-8ab7-c5e2837a14be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:36.825648 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b5d29db7-d8e3-48cf-b1a1-8dc7fe8b408e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:36.851367 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b5d29db7-d8e3-48cf-b1a1-8dc7fe8b408e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:36.905882 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b5d29db7-d8e3-48cf-b1a1-8dc7fe8b408e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:36.909607 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-fbaadc2d-2f6c-4bcd-8f80-f4ce1a44feb2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:36.922184 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5d29db7-d8e3-48cf-b1a1-8dc7fe8b408e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42352276-170a-4380-b778-8138a239286f,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:36.925047 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b5d29db7-d8e3-48cf-b1a1-8dc7fe8b408e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:36.926920 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-b5d29db7-d8e3-48cf-b1a1-8dc7fe8b408e admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:36.930547 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-b5d29db7-d8e3-48cf-b1a1-8dc7fe8b408e admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/42352276-170a-4380-b778-8138a239286f HTTP/1.1" status: 204  len: 168 time: 0.1591656
Jun 01 11:17:37.199442 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39408) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:37.217809 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:37.235516 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:17:37.239261 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] Usage tracker for resource:security_group_rule and tenant:9766c7a530f649cb913083de47d47157 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:17:37.242122 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:17:37.247790 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:17:37.338040 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:37.341784 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:37.348736 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9ff9607a-1e9a-433a-840f-447c1a3e8ff9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:37.387636 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d81f03f0-248d-412f-a435-2847499b66f1,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:37.391526 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:37.394139 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-f2b6ba00-76d2-4b68-bfc7-3c70ceb63b92 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=9766c7a530f649cb913083de47d47157&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1936896
Jun 01 11:17:37.396729 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39412) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:37.453431 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ba6e9cc6-61be-4dab-925e-0f7982a06001 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:37.478030 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ba6e9cc6-61be-4dab-925e-0f7982a06001 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:37.528727 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ba6e9cc6-61be-4dab-925e-0f7982a06001 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:37.532296 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fe110e80-e033-4c59-b79a-96747513202c tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:37.548191 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba6e9cc6-61be-4dab-925e-0f7982a06001 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d81f03f0-248d-412f-a435-2847499b66f1,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:37.550424 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ba6e9cc6-61be-4dab-925e-0f7982a06001 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:37.558390 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-ba6e9cc6-61be-4dab-925e-0f7982a06001 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:37.559480 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-ba6e9cc6-61be-4dab-925e-0f7982a06001 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/d81f03f0-248d-412f-a435-2847499b66f1 HTTP/1.1" status: 204  len: 168 time: 0.1618710
Jun 01 11:17:43.973248 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c9d83745-527c-4d1e-b61f-a188ad54fae2 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:17:44.086762 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:44.113412 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:17:44.115644 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20c5f97e-c8d2-432e-9ac1-243a4e3fdf19" -d '{"events": [{"server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "name": "network-vif-unplugged", "status": "completed", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:17:44.123365 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:17:44.129610 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:44.131377 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-25bf6bea-4c44-4a56-9ddb-5d5298a9e0de None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:44.165297 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 01 Jun 2021 11:17:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-471501e0-2ab4-4bad-bad3-52ac4bd5be5c x-openstack-request-id: req-471501e0-2ab4-4bad-bad3-52ac4bd5be5c {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:17:44.165592 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "name": "network-vif-unplugged", "status": "failed", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2", "code": 422}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:17:44.165852 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-471501e0-2ab4-4bad-bad3-52ac4bd5be5c {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:17:44.166237 dv-cinder-787764-3-iscsi neutron-server[119242]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'code': 422} returned with failed status
Jun 01 11:17:44.196750 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=c9d83745-527c-4d1e-b61f-a188ad54fae2,revision_number=6']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:44.204519 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.204867 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.205204 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.205538 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.205866 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.206191 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.206513 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.206833 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.207153 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.207471 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.207838 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.208155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:17:44.212036 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:46.700725 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:48.333361 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39508) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:48.449848 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:48.464407 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:17:48.468232 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] Usage tracker for resource:security_group_rule and tenant:bd4ff16f356946c68e67d0459679913d is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:17:48.471067 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:17:48.476779 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:17:48.555840 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:48.559526 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:48.568290 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-9a1220ed-7c6d-4943-ba3a-f7ec92d2217e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:48.607058 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=bd4ff16f356946c68e67d0459679913d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2725387
Jun 01 11:17:48.608848 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c473c636-3c69-49f1-8f9e-cde0b9c8ec8f,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:48.609706 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39514) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:48.612110 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f73cd282-b144-430d-af60-bcc281acf55f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:48.668615 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-128f3f7b-8731-415f-962d-0a3505865a83 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:48.694237 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-128f3f7b-8731-415f-962d-0a3505865a83 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:48.745046 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-128f3f7b-8731-415f-962d-0a3505865a83 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:48.748645 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-df28f704-58ab-4d9e-b49d-5fe4d1c19c4b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:48.759656 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128f3f7b-8731-415f-962d-0a3505865a83 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c473c636-3c69-49f1-8f9e-cde0b9c8ec8f,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:48.765353 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-128f3f7b-8731-415f-962d-0a3505865a83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:48.767267 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-128f3f7b-8731-415f-962d-0a3505865a83 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:48.768390 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-128f3f7b-8731-415f-962d-0a3505865a83 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/c473c636-3c69-49f1-8f9e-cde0b9c8ec8f HTTP/1.1" status: 204  len: 168 time: 0.1576836
Jun 01 11:17:49.040920 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39522) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:49.058537 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:49.073044 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:17:49.076874 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Usage tracker for resource:security_group_rule and tenant:0e69088adb2c4730a5b21bee3ca8df76 is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:17:49.079636 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:17:49.085243 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:17:49.163907 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:49.167620 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:49.179914 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7f8a9d78-7ee8-4694-bfd7-9b7849b6f889 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:49.218329 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=0e69088adb2c4730a5b21bee3ca8df76&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1758938
Jun 01 11:17:49.220102 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00b27217-5b6f-4e3f-8064-86b76fb7dc7b,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:49.221178 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39526) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:49.223129 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:49.282416 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-84f212ff-0e3d-42cb-8ad9-401403bd693a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:49.308392 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-84f212ff-0e3d-42cb-8ad9-401403bd693a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:49.362973 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-84f212ff-0e3d-42cb-8ad9-401403bd693a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:49.366858 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-851e15b6-3a5b-4125-973a-6acd4ce3ea54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:49.379243 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f212ff-0e3d-42cb-8ad9-401403bd693a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00b27217-5b6f-4e3f-8064-86b76fb7dc7b,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:49.381537 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-84f212ff-0e3d-42cb-8ad9-401403bd693a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:49.389361 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-84f212ff-0e3d-42cb-8ad9-401403bd693a admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:49.390491 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-84f212ff-0e3d-42cb-8ad9-401403bd693a admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/00b27217-5b6f-4e3f-8064-86b76fb7dc7b HTTP/1.1" status: 204  len: 168 time: 0.1683419
Jun 01 11:17:51.905473 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39600) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:52.021775 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.035906 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:17:52.039803 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Usage tracker for resource:security_group_rule and tenant:f7c169a874cd4649a40d5c397536fe56 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:17:52.042590 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:17:52.048942 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:17:52.130331 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.133930 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.141090 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0eac51d5-81c8-4617-a1e8-6e62652e2a04 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:52.179692 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d970719a-dfce-4e08-a46b-9e859d568419,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:52.182734 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:52.185379 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=f7c169a874cd4649a40d5c397536fe56&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2789087
Jun 01 11:17:52.188030 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39606) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:52.248407 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5e3c62a9-d36b-4618-98dc-f900e94c2bce admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.273591 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5e3c62a9-d36b-4618-98dc-f900e94c2bce admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.325061 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5e3c62a9-d36b-4618-98dc-f900e94c2bce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.328816 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4fd20240-96a0-4879-87c7-8a9e0d34a8a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:52.341635 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e3c62a9-d36b-4618-98dc-f900e94c2bce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d970719a-dfce-4e08-a46b-9e859d568419,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:52.344803 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5e3c62a9-d36b-4618-98dc-f900e94c2bce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:52.348080 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5e3c62a9-d36b-4618-98dc-f900e94c2bce admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.349901 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-5e3c62a9-d36b-4618-98dc-f900e94c2bce admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/d970719a-dfce-4e08-a46b-9e859d568419 HTTP/1.1" status: 204  len: 168 time: 0.1608410
Jun 01 11:17:52.621458 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39614) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:52.638815 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.653241 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:17:52.657655 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Usage tracker for resource:security_group_rule and tenant:517c95bd7a1741ba99a88e485fee2be3 is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:17:52.660473 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:17:52.666139 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:17:52.712354 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0215f336-6895-4a02-b64b-5f2f3703a3d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.749381 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.752843 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.760857 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-55b0018f-b035-4505-93de-5c83e6ede0ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:52.805055 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=517c95bd7a1741ba99a88e485fee2be3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1825507
Jun 01 11:17:52.806053 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ee9dcf0-3662-40c9-9e58-4c83ba308ad2,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:52.808343 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39618) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:17:52.809098 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:52.868921 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-690f11a3-1eab-4070-9799-9413833713e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.894608 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-690f11a3-1eab-4070-9799-9413833713e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.943939 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-690f11a3-1eab-4070-9799-9413833713e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.947503 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-346dd73d-574f-4cee-b6e2-064606443ff9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:17:52.960660 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-690f11a3-1eab-4070-9799-9413833713e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ee9dcf0-3662-40c9-9e58-4c83ba308ad2,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:17:52.964309 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-690f11a3-1eab-4070-9799-9413833713e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:17:52.969465 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-690f11a3-1eab-4070-9799-9413833713e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:52.970612 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-690f11a3-1eab-4070-9799-9413833713e2 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/3ee9dcf0-3662-40c9-9e58-4c83ba308ad2 HTTP/1.1" status: 204  len: 168 time: 0.1609268
Jun 01 11:17:55.253162 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-66026045-5c09-40c9-98e7-fcf3cd68bca2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:55.332788 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:56.410944 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:17:57.757002 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:04.814110 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39756) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:18:04.927859 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:04.942165 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:18:04.945895 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Usage tracker for resource:security_group_rule and tenant:1670b91265404ab0963b1a656e44c5ee is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:18:04.948642 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:18:04.954857 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:18:05.041227 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:05.044750 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:05.052366 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-27b8d831-7788-4924-826e-9dc080b57d2d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:18:05.091334 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=1670b91265404ab0963b1a656e44c5ee&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2761045
Jun 01 11:18:05.092821 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c8a1aa0-4d1c-4787-8d20-c6cb64590a4a,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:18:05.094065 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39762) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:18:05.100155 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.100621 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.100916 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.101287 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.101652 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.102042 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.102406 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.102767 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.103125 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.103489 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.103868 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.104246 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.108129 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f8696586-861e-4bdb-bc2d-4e710c400bbb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:18:05.154352 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:05.179079 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:05.229522 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:05.234512 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-22aafe0a-326d-4557-a918-3a81dccd8702 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:18:05.245889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c8a1aa0-4d1c-4787-8d20-c6cb64590a4a,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:18:05.257874 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.258241 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.258600 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.258952 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.259300 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.259673 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.260023 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.260368 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.260711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.261051 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.261390 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.261726 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:18:05.266290 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:18:05.267478 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:05.268599 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c3ea1605-e86e-47ef-bac0-d49a1373cb97 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/3c8a1aa0-4d1c-4787-8d20-c6cb64590a4a HTTP/1.1" status: 204  len: 168 time: 0.1735785
Jun 01 11:18:05.804530 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:18:16.703463 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:22.703699 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ae846b89-0f6e-4c6e-900a-91e91e4e6b47 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:25.254518 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8319f55f-f0fb-4c3f-9a7d-a5ffd20c74a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:25.335381 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:26.414437 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:27.754752 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:29.311317 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a41330c8-e1f5-42ff-9c60-ec8e1c1c0702 req-9284212c-f03d-40ac-9126-db8d6361083d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:29.312878 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a41330c8-e1f5-42ff-9c60-ec8e1c1c0702 req-9284212c-f03d-40ac-9126-db8d6361083d tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0832679
Jun 01 11:18:29.357509 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a41330c8-e1f5-42ff-9c60-ec8e1c1c0702 req-00cedc94-d911-4393-8b16-ab8623ecfd42 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383837
Jun 01 11:18:29.709750 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8d0ace-64b0-44f1-b3f8-317f3aaccde4 req-5fc0716b-4523-4ac4-9635-721a9b867f0f tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:29.711214 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3c8d0ace-64b0-44f1-b3f8-317f3aaccde4 req-5fc0716b-4523-4ac4-9635-721a9b867f0f tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0811918
Jun 01 11:18:29.733107 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-60d4db03-29d1-4779-90ac-824f9c4d10c3 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1632259
Jun 01 11:18:29.756047 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3c8d0ace-64b0-44f1-b3f8-317f3aaccde4 req-66e6d95b-cfa8-4e0e-98ae-f43dde12c98c tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390911
Jun 01 11:18:30.948217 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fda4ca-6f6b-42e3-8f05-157e7ccd9fd2 req-137740e4-c1d0-4603-aad5-d79b775c6592 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:30.949761 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e3fda4ca-6f6b-42e3-8f05-157e7ccd9fd2 req-137740e4-c1d0-4603-aad5-d79b775c6592 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0862038
Jun 01 11:18:30.993862 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e3fda4ca-6f6b-42e3-8f05-157e7ccd9fd2 req-647a1b0d-4d14-4642-b45e-129259290359 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383220
Jun 01 11:18:31.234447 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-c11e8e78-f0db-4b19-a1f2-5ed9b86c211d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:31.236406 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-c11e8e78-f0db-4b19-a1f2-5ed9b86c211d service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c&tenant_id=7105d2f283044a3c9f1397f5e07b0bfe HTTP/1.1" status: 200  len: 1097 time: 0.0685425
Jun 01 11:18:31.326417 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-906c93b7-b772-460e-ba1d-4a64ab8519ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:31.327875 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-906c93b7-b772-460e-ba1d-4a64ab8519ad service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1097 time: 0.0718324
Jun 01 11:18:31.455529 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-9c2b59b6-d8eb-4f3a-967f-043b2f96d53d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:31.456976 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-9c2b59b6-d8eb-4f3a-967f-043b2f96d53d service neutron] 10.222.0.79 "GET /v2.0/networks?id=a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 200  len: 910 time: 0.1232018
Jun 01 11:18:31.642810 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-1bb1be0c-224c-4b9d-a9a9-984d29885c11 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 200  len: 1000 time: 0.1793785
Jun 01 11:18:31.703236 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-b277a035-348e-4c4f-b433-587576f29852 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:31.704741 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-b277a035-348e-4c4f-b433-587576f29852 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f490a491-e776-4472-a23c-46b7b609b438 HTTP/1.1" status: 200  len: 848 time: 0.0563695
Jun 01 11:18:31.777749 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-e29c49ad-93d8-465a-8c35-582acc33f01e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:31.779164 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-e29c49ad-93d8-465a-8c35-582acc33f01e service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=a30966a5-dc46-445f-8d4a-d8da7c97fafd&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0683854
Jun 01 11:18:31.908847 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-55a143cd-9f0f-4d03-ba3e-6501012e95b8 service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1232152
Jun 01 11:18:32.038724 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0ee4bbea-8a7d-483d-8332-ea37d9630b84 req-1351abed-fbdf-4351-bd0a-6dc98012ab88 service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1240737
Jun 01 11:18:32.179738 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8f6b53-6d3c-4fe5-ae44-d1c12d71f0a9 req-0fe19466-df9d-4a07-a27e-02f8e71c0be7 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:32.181080 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8b8f6b53-6d3c-4fe5-ae44-d1c12d71f0a9 req-0fe19466-df9d-4a07-a27e-02f8e71c0be7 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0817001
Jun 01 11:18:32.225032 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8b8f6b53-6d3c-4fe5-ae44-d1c12d71f0a9 req-35cfc1ea-31cb-4d22-b66d-96271988c01c tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383952
Jun 01 11:18:33.408656 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e54f755d-078f-4cee-b350-96eba17a35f8 req-802dd203-e82d-42a9-ad6c-751453639137 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:33.410095 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e54f755d-078f-4cee-b350-96eba17a35f8 req-802dd203-e82d-42a9-ad6c-751453639137 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0802326
Jun 01 11:18:33.456541 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e54f755d-078f-4cee-b350-96eba17a35f8 req-b8bedab8-0b42-4ff5-9b23-d9161a75cf96 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408497
Jun 01 11:18:34.636475 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5715b3f7-0368-4c22-adc3-c063aac015e3 req-a9c2516d-84ff-4225-8a30-e4e0ccd1f646 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:34.637907 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5715b3f7-0368-4c22-adc3-c063aac015e3 req-a9c2516d-84ff-4225-8a30-e4e0ccd1f646 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0784822
Jun 01 11:18:34.682030 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5715b3f7-0368-4c22-adc3-c063aac015e3 req-786ee23d-f1ce-44a9-9627-735322463512 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383003
Jun 01 11:18:35.869993 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6db170-7ac9-4860-adb8-357c54f67d01 req-a81cfee4-2f6a-483a-b76d-ed43c915651b tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:35.871537 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a6db170-7ac9-4860-adb8-357c54f67d01 req-a81cfee4-2f6a-483a-b76d-ed43c915651b tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0856705
Jun 01 11:18:35.922619 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a6db170-7ac9-4860-adb8-357c54f67d01 req-3e6c9f86-2347-40f3-af79-b716fff94ad0 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0453672
Jun 01 11:18:37.105106 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46deafdd-8be3-4438-b40e-16439702887a req-fc1124de-385d-4ad8-9aa2-99167c9c1689 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:37.106536 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-46deafdd-8be3-4438-b40e-16439702887a req-fc1124de-385d-4ad8-9aa2-99167c9c1689 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0800791
Jun 01 11:18:37.150582 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-46deafdd-8be3-4438-b40e-16439702887a req-c862a7c0-56e7-4d67-9bea-5936b27eb300 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0378723
Jun 01 11:18:38.333275 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6227f7-4ec9-4c3e-8406-18cdbbe68f97 req-c93d2d70-50f5-47af-a746-92e2040792ae tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:38.334814 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fe6227f7-4ec9-4c3e-8406-18cdbbe68f97 req-c93d2d70-50f5-47af-a746-92e2040792ae tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0824819
Jun 01 11:18:38.377540 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-fe6227f7-4ec9-4c3e-8406-18cdbbe68f97 req-0f949451-c204-4408-a7fc-ea9df72e6750 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0371673
Jun 01 11:18:39.319242 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c9d83745-527c-4d1e-b61f-a188ad54fae2 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:18:39.451112 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:18:39.464583 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'port_id': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'mac_address': 'fa:16:3e:b7:17:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 675, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:18:39.519694 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:39.540868 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c9d83745-527c-4d1e-b61f-a188ad54fae2 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:18:39.556353 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:18:39.560515 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:39.560874 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed2ebd00-7dd4-4e2d-a5db-f4a2666badac req-660a6c13-f501-4baf-9a1a-c805f883fa19 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:39.562420 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ed2ebd00-7dd4-4e2d-a5db-f4a2666badac req-660a6c13-f501-4baf-9a1a-c805f883fa19 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 944 time: 0.0809312
Jun 01 11:18:39.563414 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:18:39.612439 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ed2ebd00-7dd4-4e2d-a5db-f4a2666badac req-85893fac-be70-4127-a312-3faa123459ec tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0436468
Jun 01 11:18:39.628968 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=c9d83745-527c-4d1e-b61f-a188ad54fae2,revision_number=7']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:18:39.634048 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:18:39.792769 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['c9d83745-527c-4d1e-b61f-a188ad54fae2'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:18:40.795910 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2463464f-f25b-4a9c-bec9-ca92e5b5eb1e req-cc7589e0-3a87-4b2a-a096-ae4ef4832f20 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:40.797254 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2463464f-f25b-4a9c-bec9-ca92e5b5eb1e req-cc7589e0-3a87-4b2a-a096-ae4ef4832f20 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 945 time: 0.0790334
Jun 01 11:18:40.841583 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2463464f-f25b-4a9c-bec9-ca92e5b5eb1e req-8296e568-29c1-4e20-b87c-38e6eacc6f1b tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381896
Jun 01 11:18:41.327313 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c9d83745-527c-4d1e-b61f-a188ad54fae2 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:18:41.397286 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port c9d83745-527c-4d1e-b61f-a188ad54fae2 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:18:41.397660 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:41.510829 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:41.537236 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:18:41.539442 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b61354a-5575-4d4a-8678-2ed41f71fa05" -d '{"events": [{"server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "name": "network-vif-plugged", "status": "completed", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:18:41.546720 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:18:41.555278 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:41.557274 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-f08215de-7353-4499-97ee-e2d1d000b50b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:18:41.588015 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:18:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7506d93-57a2-4fef-975e-53d1b4caf778 x-openstack-request-id: req-b7506d93-57a2-4fef-975e-53d1b4caf778 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:18:41.588410 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "name": "network-vif-plugged", "status": "completed", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:18:41.588738 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-b7506d93-57a2-4fef-975e-53d1b4caf778 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:18:41.589128 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'code': 200}
Jun 01 11:18:41.627614 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=c9d83745-527c-4d1e-b61f-a188ad54fae2,revision_number=8']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:18:41.630704 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:18:41.853562 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e0a4a1-351e-4cc8-a2c9-d4b6278928b2 req-801ca928-6ad8-4456-a224-337849a78dde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:41.854898 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-86e0a4a1-351e-4cc8-a2c9-d4b6278928b2 req-801ca928-6ad8-4456-a224-337849a78dde service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1099 time: 0.0723314
Jun 01 11:18:41.895824 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-86e0a4a1-351e-4cc8-a2c9-d4b6278928b2 req-3e539c8f-b931-4383-a67b-a9c7be649af4 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0345049
Jun 01 11:18:42.026290 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad56b04-b40b-40fc-908e-39eb59ba095b req-a4d417be-3c2b-4cc7-98e1-874a768c895f tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:42.027776 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4ad56b04-b40b-40fc-908e-39eb59ba095b req-a4d417be-3c2b-4cc7-98e1-874a768c895f tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.0800669
Jun 01 11:18:42.072194 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4ad56b04-b40b-40fc-908e-39eb59ba095b req-1c07bf71-fa09-4413-adea-62641bfb8067 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382857
Jun 01 11:18:42.803301 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:18:43.256170 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7afbfdf-87a1-4ccc-9857-3844ef0c389f req-b9fe5ef4-7a7f-44dc-8344-e522b3e690a7 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:18:43.257648 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e7afbfdf-87a1-4ccc-9857-3844ef0c389f req-b9fe5ef4-7a7f-44dc-8344-e522b3e690a7 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.0823886
Jun 01 11:18:43.300986 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e7afbfdf-87a1-4ccc-9857-3844ef0c389f req-44ba858c-f21f-4c56-98bb-cb88c0e67fca tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0378034
Jun 01 11:18:46.730546 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:52.707900 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-90565a3b-be79-4529-b8fc-a35f462cef59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:55.256604 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8d5152a9-2ea2-4119-9ea3-6ea367be9445 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:55.337534 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:56.417011 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:18:57.758113 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:15.712213 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-c96a0aae-9336-4f8d-aae0-178057b34ec3 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1229501
Jun 01 11:19:15.854591 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-66257dcd-8536-4ef1-a9cb-9be74eab0310 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:19:15.855961 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-66257dcd-8536-4ef1-a9cb-9be74eab0310 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1099 time: 0.0735714
Jun 01 11:19:16.087429 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-d076127c-983d-444f-a5b7-61c18193ed8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:19:16.088899 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-d076127c-983d-444f-a5b7-61c18193ed8c service neutron] 10.222.0.79 "GET /v2.0/networks?id=a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 200  len: 910 time: 0.2140913
Jun 01 11:19:16.190584 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-c8e5131a-293a-4184-ac8a-31959aa980c9 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 200  len: 1002 time: 0.0942607
Jun 01 11:19:16.251188 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-6656988f-309c-420d-bdc1-eb7e7f2fe136 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:19:16.252633 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-6656988f-309c-420d-bdc1-eb7e7f2fe136 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f490a491-e776-4472-a23c-46b7b609b438 HTTP/1.1" status: 200  len: 848 time: 0.0563452
Jun 01 11:19:16.328089 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-10da48c4-fec6-4e6a-aa22-14d7e5d8b968 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:19:16.329520 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-10da48c4-fec6-4e6a-aa22-14d7e5d8b968 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=a30966a5-dc46-445f-8d4a-d8da7c97fafd&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0705562
Jun 01 11:19:16.339952 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-a3ef4d82-a2e7-4924-b1f5-1fa35d9a9d52 service neutron] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119241) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:19:16.340840 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-a3ef4d82-a2e7-4924-b1f5-1fa35d9a9d52 service neutron] 10.222.0.79 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0050218
Jun 01 11:19:16.469789 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-34669144-c75f-46d2-9297-a34a2786e704 service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1219378
Jun 01 11:19:16.600683 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-33bff08c-b5fb-4442-926e-1a26ad1b8ae1 req-76e2ea5e-596c-4429-b412-2b54873703db service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1246819
Jun 01 11:19:16.763686 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:19.802918 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:19:22.712091 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b1d97666-878c-4e8b-bedd-fd5302ac53cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:25.258014 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-bf6f8f18-43ff-40e8-921a-6f4f4220c9e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:25.339633 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:26.419064 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:27.763034 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:46.785439 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:52.715789 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-258ae555-f301-4499-a5f3-aff6f0e20e26 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:55.258576 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0342292a-44a5-48ef-b1ff-7514d0e03a4b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:55.340928 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:56.421814 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:56.801533 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:19:57.763684 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:58.810207 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39832) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:19:59.175544 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Deleting port 9a5a19d7-d9b7-4747-a9b3-6b5bc69ead6e {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:19:59.176442 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:59.292500 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:59.292830 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:59.496310 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Calling delete_port for 9a5a19d7-d9b7-4747-a9b3-6b5bc69ead6e owned by network:floatingip {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:19:59.613739 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:59.617388 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-66fac625-cfe5-4b8b-ae03-ed480a239b0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:19:59.660459 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event deleted for resources: {'Port': ['ID=9a5a19d7-d9b7-4747-a9b3-6b5bc69ead6e,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:19:59.695437 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.695847 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.696218 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.696580 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.696936 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.697292 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.697643 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.697996 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.698349 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.698699 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.699046 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.699389 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:19:59.706565 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:19:59.765181 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for floatingip, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:19:59.765424 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.l3_db [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Floating IP 2bdaa297-c3ca-4e9c-b6e0-69a05b151fe6 disassociated (deleted). External IP: 172.27.3.219, port: c9d83745-527c-4d1e-b61f-a188ad54fae2.
Jun 01 11:20:00.109692 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:20:00.288241 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:20:00.297524 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] Sync routers for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:20:00.307924 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:00.308558 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57991c6bb0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:19:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:00.315567 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:00.371112 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "DELETE /v2.0/floatingips/2bdaa297-c3ca-4e9c-b6e0-69a05b151fe6 HTTP/1.1" status: 204  len: 168 time: 1.5597339
Jun 01 11:20:00.371711 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:20:00.374004 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba4c3da9-2468-4f98-ae86-069bc476c84e" -d '{"events": [{"name": "network-changed", "server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:20:00.486144 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:00.735744 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:20:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5843cb79-4977-495c-81ab-35ea4152a24a x-openstack-request-id: req-5843cb79-4977-495c-81ab-35ea4152a24a {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:20:00.736079 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:20:00.736373 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-5843cb79-4977-495c-81ab-35ea4152a24a {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:20:00.736806 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'status': 'completed', 'code': 200}
Jun 01 11:20:00.805676 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57991c6bb0>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:37Z', 'revision_number': 5, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:00.809757 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] Checking router: 5fb046d6-be4d-48d1-adb9-9caf08ce3958 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:20:00.819217 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:00.819961 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57991c6bb0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:19:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:00.838213 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-5e92aadf-741c-4cd4-9312-b481e85cb337 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:00.839847 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-5e92aadf-741c-4cd4-9312-b481e85cb337 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 1099 time: 0.0820763
Jun 01 11:20:01.037819 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-6a0b320c-159d-4ad5-8e5f-b58afbaef104 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:01.039155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:01.041939 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-6a0b320c-159d-4ad5-8e5f-b58afbaef104 service neutron] 10.222.0.79 "GET /v2.0/networks?id=a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 200  len: 910 time: 0.1945076
Jun 01 11:20:01.052140 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291fcfe3-8434-4067-9226-417d4d38eab7 req-dc8c6be5-ad3b-4e8d-bd83-452e3fcb0e27 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:01.053526 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-291fcfe3-8434-4067-9226-417d4d38eab7 req-dc8c6be5-ad3b-4e8d-bd83-452e3fcb0e27 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.2364967
Jun 01 11:20:01.131187 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-9fb68b54-36dd-42b8-8c68-2b5d92d1ce16 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 200  len: 217 time: 0.0767260
Jun 01 11:20:01.199464 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-291fcfe3-8434-4067-9226-417d4d38eab7 req-d6316c22-db43-4451-9bd9-2ee854fe5672 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0948172
Jun 01 11:20:01.213050 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-5ce3c772-13d3-4b5f-8dd8-4ba05aa907fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:01.214476 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-5ce3c772-13d3-4b5f-8dd8-4ba05aa907fe service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f490a491-e776-4472-a23c-46b7b609b438 HTTP/1.1" status: 200  len: 848 time: 0.0703256
Jun 01 11:20:01.290264 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-9d234f52-0442-4291-81ed-9faea6ea903d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:01.291674 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-9d234f52-0442-4291-81ed-9faea6ea903d service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=a30966a5-dc46-445f-8d4a-d8da7c97fafd&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0701447
Jun 01 11:20:01.347014 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57991c6bb0>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:37Z', 'revision_number': 5, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:01.351055 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1156f797-c7de-474c-83a8-ec2b966e60fb None None] The sync data for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi is: [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:14:31Z', 'revision_number': 4, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': 'c9797d4e-1313-43c6-9564-044af9755d12', 'name': '', 'network_id': 'a30966a5-dc46-445f-8d4a-d8da7c97fafd', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'mac_address': 'fa:16:3e:63:e4:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f490a491-e776-4472-a23c-46b7b609b438', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:30Z', 'updated_at': '2021-06-01T11:14:37Z', 'revision_number': 5, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'subnets': [{'id': 'f490a491-e776-4472-a23c-46b7b609b438', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:20:01.428022 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-ed1b110a-2b0a-491a-81dd-25d908f254dd service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1289113
Jun 01 11:20:01.563507 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ba4c3da9-2468-4f98-ae86-069bc476c84e req-9ff27c46-99ca-432e-979d-c93ef1a73f6a service neutron] 10.222.0.79 "GET /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1284301
Jun 01 11:20:01.563675 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-112554c2-239a-4647-a9d8-ff5df6f24a65 None None] New status for floating IP 2bdaa297-c3ca-4e9c-b6e0-69a05b151fe6: DOWN {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:20:02.205572 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50333594-fe52-4a08-ad17-f70e086dd04d req-4b161ef4-a090-458d-8d81-f2d1a2e02e54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:02.207469 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-50333594-fe52-4a08-ad17-f70e086dd04d req-4b161ef4-a090-458d-8d81-f2d1a2e02e54 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.79 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.0775080
Jun 01 11:20:02.485164 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-50333594-fe52-4a08-ad17-f70e086dd04d req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Deleting port c9d83745-527c-4d1e-b61f-a188ad54fae2 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:20:02.485397 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-50333594-fe52-4a08-ad17-f70e086dd04d req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:02.589747 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a170e2a-f3b0-4651-9e9e-c6f77ed14398 req-39bd57e2-1180-48de-b1fd-d7e233d1df97 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:02.591191 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4a170e2a-f3b0-4651-9e9e-c6f77ed14398 req-39bd57e2-1180-48de-b1fd-d7e233d1df97 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 946 time: 0.2614977
Jun 01 11:20:02.658494 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-50333594-fe52-4a08-ad17-f70e086dd04d req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] For port c9d83745-527c-4d1e-b61f-a188ad54fae2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=c9d83745-527c-4d1e-b61f-a188ad54fae2,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:02.658847 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-50333594-fe52-4a08-ad17-f70e086dd04d req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:02.676414 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4a170e2a-f3b0-4651-9e9e-c6f77ed14398 req-7f35097b-4294-42ba-83d3-dc366b7d0de7 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/security-groups?id=12440fc5-32f5-4005-bb76-cf9e245c04c3&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0708449
Jun 01 11:20:02.787320 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-50333594-fe52-4a08-ad17-f70e086dd04d req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Calling delete_port for c9d83745-527c-4d1e-b61f-a188ad54fae2 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:20:02.897786 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-50333594-fe52-4a08-ad17-f70e086dd04d req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:02.903633 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-36804b0f-f6bd-4998-8b35-87c3b0b6ae7d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:02.950756 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event deleted for resources: {'Port': ['ID=c9d83745-527c-4d1e-b61f-a188ad54fae2,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:02.991138 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.991503 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.991887 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.992243 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.992591 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.992940 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.993280 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.993621 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.993965 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.994305 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.994643 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:02.994981 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:03.021486 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:03.035335 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-50333594-fe52-4a08-ad17-f70e086dd04d req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] No DVR routers for this DVR port c9d83745-527c-4d1e-b61f-a188ad54fae2 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:20:03.037719 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-50333594-fe52-4a08-ad17-f70e086dd04d req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:03.040127 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'name': 'network-vif-deleted', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:20:03.042344 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-747a1b7e-5dcb-4f07-87e4-e32caea1e206" -d '{"events": [{"server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "name": "network-vif-deleted", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:20:03.052283 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-50333594-fe52-4a08-ad17-f70e086dd04d req-7fc2a3aa-6126-4172-b6e5-ca389e152cfe tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.79 "DELETE /v2.0/ports/c9d83745-527c-4d1e-b61f-a188ad54fae2 HTTP/1.1" status: 204  len: 173 time: 0.8399827
Jun 01 11:20:03.142754 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:20:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7c7387a-f36c-4ea8-8033-8f8fc32ace2b x-openstack-request-id: req-a7c7387a-f36c-4ea8-8033-8f8fc32ace2b {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:20:03.143082 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4815fab1-44e7-4263-a2aa-ca70ed97054c", "name": "network-vif-deleted", "tag": "c9d83745-527c-4d1e-b61f-a188ad54fae2", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:20:03.143362 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-a7c7387a-f36c-4ea8-8033-8f8fc32ace2b {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:20:03.143815 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4815fab1-44e7-4263-a2aa-ca70ed97054c', 'name': 'network-vif-deleted', 'tag': 'c9d83745-527c-4d1e-b61f-a188ad54fae2', 'status': 'completed', 'code': 200}
Jun 01 11:20:03.841664 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-0a1ad937-6cdf-4198-bb5b-2e46acb8ff55 req-a9407620-e249-4db3-b13d-ab880e822605 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Synchronizing usage tracker for tenant:7105d2f283044a3c9f1397f5e07b0bfe on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:20:03.857704 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-0a1ad937-6cdf-4198-bb5b-2e46acb8ff55 req-a9407620-e249-4db3-b13d-ab880e822605 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Unset dirty status for tenant:7105d2f283044a3c9f1397f5e07b0bfe on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:20:03.859006 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0a1ad937-6cdf-4198-bb5b-2e46acb8ff55 req-a9407620-e249-4db3-b13d-ab880e822605 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "GET /v2.0/ports?device_id=4815fab1-44e7-4263-a2aa-ca70ed97054c HTTP/1.1" status: 200  len: 210 time: 0.0600493
Jun 01 11:20:04.951851 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39860) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:05.024625 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2d808540-32da-418d-a553-33025b0396cf tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:05.054441 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2d808540-32da-418d-a553-33025b0396cf tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:05.119646 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2d808540-32da-418d-a553-33025b0396cf tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:05.123406 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-ffd357ea-a9a2-4182-bf3d-89b3f6c9ae4b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:05.140999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d808540-32da-418d-a553-33025b0396cf tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=12440fc5-32f5-4005-bb76-cf9e245c04c3,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:05.143641 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2d808540-32da-418d-a553-33025b0396cf tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:05.154707 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-2d808540-32da-418d-a553-33025b0396cf tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:05.155966 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-2d808540-32da-418d-a553-33025b0396cf tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] 10.222.0.74 "DELETE /v2.0/security-groups/12440fc5-32f5-4005-bb76-cf9e245c04c3 HTTP/1.1" status: 204  len: 168 time: 0.2030623
Jun 01 11:20:05.201493 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39866) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:05.687124 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c9d83745-527c-4d1e-b61f-a188ad54fae2 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:20:05.725728 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: c9d83745-527c-4d1e-b61f-a188ad54fae2 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:20:05.726083 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device c9d83745-527c-4d1e-b61f-a188ad54fae2 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:20:05.829238 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-926124'] for router_interface, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:06.333632 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Deleting port c9797d4e-1313-43c6-9564-044af9755d12 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:20:06.334357 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:06.460188 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] For port c9797d4e-1313-43c6-9564-044af9755d12, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=c9797d4e-1313-43c6-9564-044af9755d12,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:06.460543 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:06.581336 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Calling delete_port for c9797d4e-1313-43c6-9564-044af9755d12 owned by network:router_interface {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:20:06.733217 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:06.737538 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:06.782156 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Pushing event deleted for resources: {'Port': ['ID=c9797d4e-1313-43c6-9564-044af9755d12,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:06.812011 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:07.048516 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-776947', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-646716'] for router_interface, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:07.493141 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:20:07.668367 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:20:07.677337 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] Sync routers for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:20:07.686774 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:07.687397 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798340640>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:19:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:07.687617 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39872) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:07.692662 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-46bdb934-c461-4986-845b-5de679a3cc5d admin admin] 10.222.0.74 "PUT /v2.0/routers/5fb046d6-be4d-48d1-adb9-9caf08ce3958/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4897492
Jun 01 11:20:07.860176 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks [] for router, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:07.863704 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:08.037457 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:08.107620 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Deleting port f0df6b1b-fd4f-41af-9da0-3803e4632bd7 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:20:08.107983 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:08.149803 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798340640>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:20:06Z', 'revision_number': 5, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port': {'id': 'f0df6b1b-fd4f-41af-9da0-3803e4632bd7', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:ce:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'device_owner': 'network:router_gateway', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:27Z', 'updated_at': '2021-06-01T11:14:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:08.153553 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] Checking router: 5fb046d6-be4d-48d1-adb9-9caf08ce3958 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:20:08.162535 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] Routers {'5fb046d6-be4d-48d1-adb9-9caf08ce3958'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:08.163145 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798340640>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:19:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:08.231017 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] For port f0df6b1b-fd4f-41af-9da0-3803e4632bd7, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f0df6b1b-fd4f-41af-9da0-3803e4632bd7,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:08.231374 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:08.310912 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] Set router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 gateway port host: None {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:08.355112 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Calling delete_port for f0df6b1b-fd4f-41af-9da0-3803e4632bd7 owned by network:router_gateway {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:20:08.423675 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798340640>, [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:20:08Z', 'revision_number': 6, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port_host': None}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:08.428109 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c74d8277-5613-4bf6-8988-c0f7035ce39c None None] The sync data for ids ['5fb046d6-be4d-48d1-adb9-9caf08ce3958'] in dv-cinder-787764-3-iscsi is: [{'id': '5fb046d6-be4d-48d1-adb9-9caf08ce3958', 'name': 'tempest-TestShelveInstance-1015271761-router', 'tenant_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:26Z', 'updated_at': '2021-06-01T11:20:08Z', 'revision_number': 6, 'project_id': '7105d2f283044a3c9f1397f5e07b0bfe', 'gw_port_host': None}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:20:08.718412 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:08.722300 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-380a3771-40d2-4135-bb26-2757d5c46d63 tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:08.802041 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Pushing event deleted for resources: {'Port': ['ID=f0df6b1b-fd4f-41af-9da0-3803e4632bd7,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:08.804571 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:08.827245 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device c9797d4e-1313-43c6-9564-044af9755d12 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:20:08.869055 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: c9797d4e-1313-43c6-9564-044af9755d12 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:20:08.869478 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device c9797d4e-1313-43c6-9564-044af9755d12 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:20:08.870196 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-645297'] for router_gateway, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.041159 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-643132', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4050'] for router, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.043229 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.125860 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-643584'] for router, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.126384 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5fb046d6-be4d-48d1-adb9-9caf08ce3958 {{(pid=119241) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 11:20:09.139386 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] Notify callbacks [] for router, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.140532 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-25e43be9-a3dc-42f2-8bea-66ab73b85f4c admin admin] 10.222.0.74 "DELETE /v2.0/routers/5fb046d6-be4d-48d1-adb9-9caf08ce3958 HTTP/1.1" status: 204  len: 168 time: 1.4519475
Jun 01 11:20:09.143289 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39876) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:09.203188 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_v2 [None req-3c14d33e-309f-4d37-a4aa-e918b8773635 admin admin] Deleting subnet f490a491-e776-4472-a23c-46b7b609b438 {{(pid=119241) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:20:09.206141 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3c14d33e-309f-4d37-a4aa-e918b8773635 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.255037 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3c14d33e-309f-4d37-a4aa-e918b8773635 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10844045'] for subnet, precommit_delete_associations {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.336287 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3c14d33e-309f-4d37-a4aa-e918b8773635 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.577729 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3c14d33e-309f-4d37-a4aa-e918b8773635 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10882836', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10623430'] for subnet, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.581504 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-566b1945-94a1-4be7-9091-6e732bfb4f02 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:09.618626 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c14d33e-309f-4d37-a4aa-e918b8773635 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f490a491-e776-4472-a23c-46b7b609b438,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:09.621396 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3c14d33e-309f-4d37-a4aa-e918b8773635 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:09.622333 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-3c14d33e-309f-4d37-a4aa-e918b8773635 admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.627505 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f253895-e0d1-4717-a3c4-6187ddef1f6b None None] Network a30966a5-dc46-445f-8d4a-d8da7c97fafd requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:20:09.629232 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-3c14d33e-309f-4d37-a4aa-e918b8773635 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/f490a491-e776-4472-a23c-46b7b609b438 HTTP/1.1" status: 204  len: 168 time: 0.4844627
Jun 01 11:20:09.631686 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39880) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:09.736682 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.813788 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Deleting port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:20:09.814197 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:09.933007 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] DHCP port deletion for a30966a5-dc46-445f-8d4a-d8da7c97fafd request from dv-cinder-787764-3-iscsi {{(pid=119242) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 11:20:10.002129 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Deleting port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda {{(pid=119242) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:20:10.002517 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.021863 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] For port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=4ab6cb52-1785-4fdb-bf66-a0fbafc04eda,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:10.022220 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.105347 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] For port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=4ab6cb52-1785-4fdb-bf66-a0fbafc04eda,segment=NetworkSegment(58584179-37ca-4343-8b13-9870bf67c2d6),segment_id=58584179-37ca-4343-8b13-9870bf67c2d6)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:10.105745 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.143579 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Calling delete_port for 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda owned by network:dhcp {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:20:10.191260 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.195137 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:10.226990 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Calling delete_port for 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda owned by network:dhcp {{(pid=119242) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:20:10.241017 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Pushing event deleted for resources: {'Port': ['ID=4ab6cb52-1785-4fdb-bf66-a0fbafc04eda,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:10.244171 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:10.244937 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] No DVR routers for this DVR port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda on host dv-cinder-787764-3-iscsi {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:20:10.269408 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676'] for port, after_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.273881 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:10.316117 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Pushing event deleted for resources: {'Port': ['ID=4ab6cb52-1785-4fdb-bf66-a0fbafc04eda,revision_number=None']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:10.320860 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] No DVR routers for this DVR port 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda on host dv-cinder-787764-3-iscsi {{(pid=119242) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:20:10.326816 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.327167 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.327508 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.327869 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.328202 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.328532 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.328859 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.329182 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.329625 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.329817 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.330136 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.330454 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:10.333339 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:10.360873 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.374091 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f57934909d0>,) {'filters': {'network_id': ['a30966a5-dc46-445f-8d4a-d8da7c97fafd']}} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:10.386129 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f57934909d0>, '58584179-37ca-4343-8b13-9870bf67c2d6') {'for_net_delete': True} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:10.386406 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.services.segments.db [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f57934909d0>, '58584179-37ca-4343-8b13-9870bf67c2d6') {} {{(pid=119241) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:10.398272 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10844038'] for segment, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.414266 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.420146 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Releasing vlan 675 on physical network physnet1 to pool {{(pid=119241) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:20:10.420525 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10959794'] for segment, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]: Traceback (most recent call last):
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     timer()
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     cb(*args, **kw)
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     return func(*args, **kwargs)
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     self._notify()
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     self.callback(batched_events)
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     event.method(event)
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     return f(self, *a, **k)
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._get(url).json()
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:20:10.433442 dv-cinder-787764-3-iscsi neutron-server[119241]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:20:10.509261 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.513917 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:10.516920 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-459a7c4f-b7e0-4e8d-8134-1a96aac23484 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:10.539149 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Pushing event deleted for resources: {'Network': ['ID=a30966a5-dc46-445f-8d4a-d8da7c97fafd,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:10.541538 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:10.553117 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] 10.222.0.74 "DELETE /v2.0/networks/a30966a5-dc46-445f-8d4a-d8da7c97fafd HTTP/1.1" status: 204  len: 168 time: 0.9204841
Jun 01 11:20:10.555931 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39884) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:10.623829 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f0df6b1b-fd4f-41af-9da0-3803e4632bd7 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:20:10.659789 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: f0df6b1b-fd4f-41af-9da0-3803e4632bd7 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:20:10.660774 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f0df6b1b-fd4f-41af-9da0-3803e4632bd7 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:20:10.661266 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:20:10.694005 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:20:10.694364 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 4ab6cb52-1785-4fdb-bf66-a0fbafc04eda not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:20:11.080143 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-926124'] for router_interface, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:11.579204 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Deleting port b3466c6d-ebf3-44dd-9234-ecea275a28d0 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:20:11.579541 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:11.697796 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] For port b3466c6d-ebf3-44dd-9234-ecea275a28d0, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=b3466c6d-ebf3-44dd-9234-ecea275a28d0,segment=NetworkSegment(809c0da7-01a9-42fc-9673-27dab824c772),segment_id=809c0da7-01a9-42fc-9673-27dab824c772)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:11.698148 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:11.818683 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Calling delete_port for b3466c6d-ebf3-44dd-9234-ecea275a28d0 owned by network:router_interface {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:20:11.970705 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:11.974242 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2b0c58df-3b5a-4291-a6eb-db5af9085b9e tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:12.018317 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Pushing event deleted for resources: {'Port': ['ID=b3466c6d-ebf3-44dd-9234-ecea275a28d0,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:12.021446 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:12.281486 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-776947', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-646716'] for router_interface, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:12.632181 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Router 0791e9cb-453f-46b2-8069-4d3ba2947899 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:20:12.912320 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:20:12.920648 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] Sync routers for ids ['0791e9cb-453f-46b2-8069-4d3ba2947899'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:20:12.921109 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] 10.222.0.74 "PUT /v2.0/routers/0791e9cb-453f-46b2-8069-4d3ba2947899/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.3639936
Jun 01 11:20:12.923427 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39888) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:12.929981 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] Routers {'0791e9cb-453f-46b2-8069-4d3ba2947899'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:12.930585 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579909a490>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:19:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['0791e9cb-453f-46b2-8069-4d3ba2947899'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:13.099716 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks [] for router, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:13.104105 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] Set router 0791e9cb-453f-46b2-8069-4d3ba2947899 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:13.275819 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:13.346517 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Deleting port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:20:13.347247 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:13.411061 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579909a490>, [{'id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:20:11Z', 'revision_number': 5, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'gw_port': {'id': 'a8101963-8b0b-49ed-a2c5-db4a1a0c93a0', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:dc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:14:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:13.414851 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] Checking router: 0791e9cb-453f-46b2-8069-4d3ba2947899 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:20:13.423782 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] Routers {'0791e9cb-453f-46b2-8069-4d3ba2947899'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:13.424395 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579909a490>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:19:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['0791e9cb-453f-46b2-8069-4d3ba2947899'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:13.470525 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] For port a8101963-8b0b-49ed-a2c5-db4a1a0c93a0, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=a8101963-8b0b-49ed-a2c5-db4a1a0c93a0,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:13.470879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:13.570139 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] Set router 0791e9cb-453f-46b2-8069-4d3ba2947899 gateway port host: None {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:13.592972 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Calling delete_port for a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 owned by network:router_gateway {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:20:13.672657 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579909a490>, [{'id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:20:13Z', 'revision_number': 6, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'gw_port_host': None}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:13.677064 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8bd531b-2a45-4708-985c-5de553b78f42 None None] The sync data for ids ['0791e9cb-453f-46b2-8069-4d3ba2947899'] in dv-cinder-787764-3-iscsi is: [{'id': '0791e9cb-453f-46b2-8069-4d3ba2947899', 'name': 'tempest-TestShelveInstance-1470422257-router', 'tenant_id': '41dbddfbf95248d5a754fbd84e666185', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:14:36Z', 'updated_at': '2021-06-01T11:20:13Z', 'revision_number': 6, 'project_id': '41dbddfbf95248d5a754fbd84e666185', 'gw_port_host': None}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:20:13.734828 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:13.739713 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-747066d7-04c6-4b7f-8e53-1065fa2a15d4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:13.782917 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Pushing event deleted for resources: {'Port': ['ID=a8101963-8b0b-49ed-a2c5-db4a1a0c93a0,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:13.808995 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:13.874729 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-645297'] for router_gateway, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.045942 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-643132', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4050'] for router, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.048284 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.073755 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-643584'] for router, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.074398 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0791e9cb-453f-46b2-8069-4d3ba2947899 {{(pid=119241) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 11:20:14.086929 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Notify callbacks [] for router, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.090357 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] 10.222.0.74 "DELETE /v2.0/routers/0791e9cb-453f-46b2-8069-4d3ba2947899 HTTP/1.1" status: 204  len: 168 time: 1.1637113
Jun 01 11:20:14.090605 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39892) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:14.150535 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_v2 [None req-bfc2b37f-b0fe-4ae6-924e-eca2e4ddc5d2 admin admin] Deleting subnet 3b5f5f5b-e070-408f-acb0-c059a55b7236 {{(pid=119241) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:20:14.153346 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bfc2b37f-b0fe-4ae6-924e-eca2e4ddc5d2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.203598 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bfc2b37f-b0fe-4ae6-924e-eca2e4ddc5d2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10844045'] for subnet, precommit_delete_associations {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.382131 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bfc2b37f-b0fe-4ae6-924e-eca2e4ddc5d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.637560 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bfc2b37f-b0fe-4ae6-924e-eca2e4ddc5d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10882836', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10623430'] for subnet, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.640213 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device b3466c6d-ebf3-44dd-9234-ecea275a28d0 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:20:14.642437 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:14.674980 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc2b37f-b0fe-4ae6-924e-eca2e4ddc5d2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3b5f5f5b-e070-408f-acb0-c059a55b7236,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:14.676195 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: b3466c6d-ebf3-44dd-9234-ecea275a28d0 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:20:14.677072 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device b3466c6d-ebf3-44dd-9234-ecea275a28d0 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:20:14.677072 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:20:14.679057 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-bfc2b37f-b0fe-4ae6-924e-eca2e4ddc5d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:14.683359 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-bfc2b37f-b0fe-4ae6-924e-eca2e4ddc5d2 admin admin] Notify callbacks [] for subnet, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.692948 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39896) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:14.703118 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-bfc2b37f-b0fe-4ae6-924e-eca2e4ddc5d2 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/3b5f5f5b-e070-408f-acb0-c059a55b7236 HTTP/1.1" status: 204  len: 168 time: 0.6114140
Jun 01 11:20:14.708030 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94dbabda-b3b3-414e-9670-8f197c495366 None None] Network 752d795b-2d24-4813-8699-de94831f729d requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:20:14.737131 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:20:14.737475 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device a8101963-8b0b-49ed-a2c5-db4a1a0c93a0 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:20:14.805563 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.876445 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Deleting port 4634c1b1-c304-4ba1-8838-1ca98077fc34 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:20:14.876789 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:14.954309 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] DHCP port deletion for 752d795b-2d24-4813-8699-de94831f729d request from dv-cinder-787764-3-iscsi {{(pid=119242) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 11:20:14.979109 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] For port 4634c1b1-c304-4ba1-8838-1ca98077fc34, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=4634c1b1-c304-4ba1-8838-1ca98077fc34,segment=NetworkSegment(809c0da7-01a9-42fc-9673-27dab824c772),segment_id=809c0da7-01a9-42fc-9673-27dab824c772)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:14.979393 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.020577 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] Deleting port 4634c1b1-c304-4ba1-8838-1ca98077fc34 {{(pid=119242) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:20:15.020947 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.104931 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Calling delete_port for 4634c1b1-c304-4ba1-8838-1ca98077fc34 owned by network:dhcp {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:20:15.115896 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] For port 4634c1b1-c304-4ba1-8838-1ca98077fc34, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=4634c1b1-c304-4ba1-8838-1ca98077fc34,segment=NetworkSegment(809c0da7-01a9-42fc-9673-27dab824c772),segment_id=809c0da7-01a9-42fc-9673-27dab824c772)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:15.116292 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.151447 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.155316 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-fc7c58db-0c05-4989-bb08-ea9d5da9edd2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:15.200678 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Pushing event deleted for resources: {'Port': ['ID=4634c1b1-c304-4ba1-8838-1ca98077fc34,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:15.203132 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:15.208047 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] No DVR routers for this DVR port 4634c1b1-c304-4ba1-8838-1ca98077fc34 on host dv-cinder-787764-3-iscsi {{(pid=119240) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:20:15.239891 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] Calling delete_port for 4634c1b1-c304-4ba1-8838-1ca98077fc34 owned by network:dhcp {{(pid=119242) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:20:15.281206 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676'] for port, after_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.284655 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:15.324405 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.327366 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] Pushing event deleted for resources: {'Port': ['ID=4634c1b1-c304-4ba1-8838-1ca98077fc34,revision_number=None']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:15.329162 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] No DVR routers for this DVR port 4634c1b1-c304-4ba1-8838-1ca98077fc34 on host dv-cinder-787764-3-iscsi {{(pid=119242) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:20:15.330333 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:15.342424 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f5793c62340>,) {'filters': {'network_id': ['752d795b-2d24-4813-8699-de94831f729d']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:15.354695 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f5793c62340>, '809c0da7-01a9-42fc-9673-27dab824c772') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:15.354991 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f5793c62340>, '809c0da7-01a9-42fc-9673-27dab824c772') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:15.366091 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.382558 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.388726 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Releasing vlan 651 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:20:15.389104 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:20:15.402847 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:20:15.480706 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.484201 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:15.496849 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.506931 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Pushing event deleted for resources: {'Network': ['ID=752d795b-2d24-4813-8699-de94831f729d,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:15.509815 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:15.511365 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-37ddb091-1adb-455a-a53c-a1080a288660 admin admin] 10.222.0.74 "DELETE /v2.0/networks/752d795b-2d24-4813-8699-de94831f729d HTTP/1.1" status: 204  len: 168 time: 0.8173654
Jun 01 11:20:15.623838 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39902) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:15.671996 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-262e5274-cd2d-4a92-ae6d-1f65fb54338a admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=7105d2f283044a3c9f1397f5e07b0bfe&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0469286
Jun 01 11:20:15.674323 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39906) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:15.733254 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5910261f-f863-4c4f-80ef-6f2f8b55d8be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.759045 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5910261f-f863-4c4f-80ef-6f2f8b55d8be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.810193 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5910261f-f863-4c4f-80ef-6f2f8b55d8be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.813736 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-a1b4bf4a-f32a-4aee-bee6-4c276d4d753d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:15.827296 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5910261f-f863-4c4f-80ef-6f2f8b55d8be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d266a02f-8fda-45f1-ae8f-b4f9e2374f86,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:15.831071 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5910261f-f863-4c4f-80ef-6f2f8b55d8be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:15.834777 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5910261f-f863-4c4f-80ef-6f2f8b55d8be admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:15.835924 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5910261f-f863-4c4f-80ef-6f2f8b55d8be admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/d266a02f-8fda-45f1-ae8f-b4f9e2374f86 HTTP/1.1" status: 204  len: 168 time: 0.1607006
Jun 01 11:20:16.168940 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39914) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:16.222009 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-47e600d2-9c04-46ce-beb8-0f47480cac50 admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=41dbddfbf95248d5a754fbd84e666185&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0518575
Jun 01 11:20:16.224367 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39918) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:16.281483 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9f8c3f9a-181c-4745-8fe1-0e9cea86e746 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:16.307326 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9f8c3f9a-181c-4745-8fe1-0e9cea86e746 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:16.359508 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9f8c3f9a-181c-4745-8fe1-0e9cea86e746 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:16.363848 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-0b7abbce-da4d-4958-a758-a65ff284bb45 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:16.376324 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f8c3f9a-181c-4745-8fe1-0e9cea86e746 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=400c076f-df06-4301-9de7-f33cff49cc46,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:16.379210 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9f8c3f9a-181c-4745-8fe1-0e9cea86e746 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:16.381345 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9f8c3f9a-181c-4745-8fe1-0e9cea86e746 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:16.382436 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-9f8c3f9a-181c-4745-8fe1-0e9cea86e746 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/400c076f-df06-4301-9de7-f33cff49cc46 HTTP/1.1" status: 204  len: 168 time: 0.1572034
Jun 01 11:20:16.625501 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 4634c1b1-c304-4ba1-8838-1ca98077fc34 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:20:16.662961 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 4634c1b1-c304-4ba1-8838-1ca98077fc34 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:20:16.663383 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 4634c1b1-c304-4ba1-8838-1ca98077fc34 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:20:16.780061 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:17.118752 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39942) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:17.222239 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1842838909-network', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:17.226802 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:17.230634 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Usage tracker for resource:network and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:17.233591 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:17.239830 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:17.249439 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Made reservation on behalf of 858ec485cd65427ca55a7bbfe0be5efe for: {'network': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:20:17.251738 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:17.264300 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:17.278418 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:17.282219 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Usage tracker for resource:security_group_rule and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:17.285004 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:17.290685 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:17.375457 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:17.380002 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:17.382897 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0b6416f1-66c0-43c4-b78b-162ced648553 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:17.420444 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 689}  {{(pid=119241) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:20:17.428964 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c640255a-ffef-4df4-95fb-956b677e31ba,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:17.434552 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:17.435490 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:17.435861 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.segments_db [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Added segment 4caee24c-4c25-4ae5-bbe3-00c9bec6902a of type vlan for network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e
Jun 01 11:20:17.462859 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:17.491545 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:17.492936 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:17.493507 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:17.496640 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:17.595844 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.4759581
Jun 01 11:20:17.596890 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Pushing event updated for resources: {'Network': ['ID=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:17.598741 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39948) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:17.599547 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:17.604842 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Request body: {'subnet': {'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1842838909-subnet', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'ip_version': 4}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:17.607007 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:20:17.612041 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:17.616003 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Usage tracker for resource:subnet and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:17.618962 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:17.625250 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:17.636515 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Made reservation on behalf of 858ec485cd65427ca55a7bbfe0be5efe for: {'subnet': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:20:17.638862 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-11313286'] for subnet, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.110519 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10700502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-11313296'] for subnet, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.115414 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:18.185312 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=241dacc7-1074-4a81-a1a4-074010054ea6,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:18.188655 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:18.194702 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Checking segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:20:18.195048 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Network hostable DHCP agents. Network: 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119240) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:20:18.212083 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119240) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:20:18.220605 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e) {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:18.229144 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:18.229739 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.230231 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47520a92-9a68-4878-87d0-ade4b0f9b5fb None None] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:20:18.254863 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-711e7854-8eba-4815-a85c-364d1e50ecd8 admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 0.6548638
Jun 01 11:20:18.257356 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39952) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:18.262992 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:18.268202 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:18.272117 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Usage tracker for resource:router and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:18.275037 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:18.280806 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:18.291568 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.292555 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.308168 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.473608 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:20:18.474454 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.570955 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.630617 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Allocated IP 172.20.0.2 (8234ed64-9e09-4fc8-a5b1-b67ff870ca9e/241dacc7-1074-4a81-a1a4-074010054ea6/f0322668-1302-4ea0-aa95-18beae9d3646) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:20:18.831376 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.841918 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Transition to ACTIVE for port object f0322668-1302-4ea0-aa95-18beae9d3646 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:18.860350 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Transition to ACTIVE for port object f0322668-1302-4ea0-aa95-18beae9d3646 will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:18.866259 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.869760 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-1fa6be90-546c-4e11-b254-76ac726c942f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:18.879096 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.913267 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:18.936237 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:20:18.939054 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:18.942457 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:20:18.948382 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Pushing event updated for resources: {'Port': ['ID=f0322668-1302-4ea0-aa95-18beae9d3646,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:18.952550 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:19.038616 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Attempting to bind port f0322668-1302-4ea0-aa95-18beae9d3646 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:20:19.039119 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Attempting to bind port f0322668-1302-4ea0-aa95-18beae9d3646 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:20:19.039488 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Attempting to bind port f0322668-1302-4ea0-aa95-18beae9d3646 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:20:19.044805 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 19, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:20:19.045182 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Checking segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:20:19.045582 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:19.045848 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Allocated IP 172.27.3.188 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/55efbe93-08e3-4768-ac7b-d48d5ea5bb31) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:20:19.045979 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Bound using segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:20:19.046444 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Bound port: f0322668-1302-4ea0-aa95-18beae9d3646, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:20:19.046822 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:19.139772 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] For port f0322668-1302-4ea0-aa95-18beae9d3646, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:20:19.143350 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] For port f0322668-1302-4ea0-aa95-18beae9d3646, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f0322668-1302-4ea0-aa95-18beae9d3646,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:20:19.147749 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:19.152172 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-03cc22c7-baee-4cf5-b61c-ba9bd92f1dea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:19.202454 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:19.233657 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:19.238766 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5cacc854-4086-4a29-99e2-dce7b6bddde2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:19.247857 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Pushing event updated for resources: {'Port': ['ID=f0322668-1302-4ea0-aa95-18beae9d3646,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:19.250911 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:19.410391 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:20:19.420407 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:19.420407 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:20:19.461901 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Pushing event updated for resources: {'Port': ['ID=55efbe93-08e3-4768-ac7b-d48d5ea5bb31,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:19.469313 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:19.848440 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:20.146064 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1565ee33-179c-45f7-a329-78d88a0c0f80 None None] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:20:20.202220 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:20.250187 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-b5e9075c-dad9-44bf-b15f-b50f0a890f69 None None] Provisioning for port f0322668-1302-4ea0-aa95-18beae9d3646 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:20.405041 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Router a59f8c59-1a3a-4919-8e53-9db5a22f8dde is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119240) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:20:20.589817 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:20:20.600692 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Sync routers for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:20:20.612180 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:20.612796 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5792f98880>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:19:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:20.619012 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:20.622891 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-89a61f1a-6dc2-47a1-9a14-99c07d98d2f5 admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 2.3617375
Jun 01 11:20:20.623079 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39956) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:20.672361 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f0322668-1302-4ea0-aa95-18beae9d3646 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:20.850703 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port f0322668-1302-4ea0-aa95-18beae9d3646 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:20.854531 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:20.990208 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port f0322668-1302-4ea0-aa95-18beae9d3646 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:20.990635 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.248055 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.292967 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port f0322668-1302-4ea0-aa95-18beae9d3646, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f0322668-1302-4ea0-aa95-18beae9d3646,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:21.299172 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.302143 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:21.355120 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5792f98880>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:19Z', 'revision_number': 3, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:21.362712 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Checking router: a59f8c59-1a3a-4919-8e53-9db5a22f8dde for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:20:21.363657 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Updating router a59f8c59-1a3a-4919-8e53-9db5a22f8dde port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:20:21.395787 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.420747 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=f0322668-1302-4ea0-aa95-18beae9d3646,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:21.424887 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:21.427887 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.604144 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Allocated IP 172.20.0.1 (8234ed64-9e09-4fc8-a5b1-b67ff870ca9e/241dacc7-1074-4a81-a1a4-074010054ea6/25dca142-5ab7-4214-a502-7b78c0f77cd2) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:20:21.751972 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.752811 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.764939 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Transition to ACTIVE for port object 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:21.768415 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Transition to ACTIVE for port object 25dca142-5ab7-4214-a502-7b78c0f77cd2 will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:21.772559 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.776955 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-b7c4c1c6-dfcd-462b-97c6-a0e316c32a2f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:21.792350 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.796044 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-33192873-3524-49a2-82f8-67c920f831eb tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:21.856543 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Attempting to bind port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:20:21.856875 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Attempting to bind port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:20:21.857190 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Attempting to bind port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:20:21.863486 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:20:21.867010 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:21.868067 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 19, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:20:21.868955 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:20:21.868955 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.869275 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:20:21.869738 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Bound port: 55efbe93-08e3-4768-ac7b-d48d5ea5bb31, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:20:21.870123 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.870917 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:20:21.906816 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Pushing event updated for resources: {'Port': ['ID=25dca142-5ab7-4214-a502-7b78c0f77cd2,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:21.911721 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:21.924150 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c5ef12-83b3-4b35-831d-83931c05596e None None] Pushing event updated for resources: {'Port': ['ID=55efbe93-08e3-4768-ac7b-d48d5ea5bb31,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:21.929593 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-45c5ef12-83b3-4b35-831d-83931c05596e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:21.932427 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.965874 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] For port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:20:21.969278 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] For port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=55efbe93-08e3-4768-ac7b-d48d5ea5bb31,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:20:21.975245 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:21.979010 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-38f15796-245b-450a-90b1-73e6a44ef92f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:22.062509 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:22.063150 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5792f98880>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:19:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:22.137862 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c5ef12-83b3-4b35-831d-83931c05596e None None] Pushing event updated for resources: {'Port': ['ID=55efbe93-08e3-4768-ac7b-d48d5ea5bb31,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:22.156685 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-45c5ef12-83b3-4b35-831d-83931c05596e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:22.199522 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:22.214475 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-68b44261-8713-4f2c-965c-4f24ba9b1db2 None None] Provisioning for port 25dca142-5ab7-4214-a502-7b78c0f77cd2 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:22.233637 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-68b44261-8713-4f2c-965c-4f24ba9b1db2 None None] Provisioning complete for port 25dca142-5ab7-4214-a502-7b78c0f77cd2 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:22.234039 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-68b44261-8713-4f2c-965c-4f24ba9b1db2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:22.305597 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-68b44261-8713-4f2c-965c-4f24ba9b1db2 None None] Port 25dca142-5ab7-4214-a502-7b78c0f77cd2 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:20:22.311117 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:22.528111 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:22.532756 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:22.560233 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-665003a4-4457-499d-ad2b-568813046130 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:22.639313 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f0322668-1302-4ea0-aa95-18beae9d3646 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:22.642762 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Pushing event updated for resources: {'Port': ['ID=25dca142-5ab7-4214-a502-7b78c0f77cd2,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:22.645405 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:22.649084 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:22.679294 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5792f98880>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:19Z', 'revision_number': 3, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:22.693347 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76e27b22-b57a-4849-86ca-50a85672f06f None None] The sync data for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi is: [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:19Z', 'revision_number': 3, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:20:22.730665 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-d510320e-7ab5-47a6-acb4-7a934ebbef64 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:22.732996 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port f0322668-1302-4ea0-aa95-18beae9d3646 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:22.733433 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:22.791143 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:20:22.792216 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:23.007620 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Router a59f8c59-1a3a-4919-8e53-9db5a22f8dde has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:20:23.131790 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-15658011-6bfe-445f-a9a3-9030055677da None None] Provisioning complete for port 25dca142-5ab7-4214-a502-7b78c0f77cd2 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:23.132205 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-15658011-6bfe-445f-a9a3-9030055677da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:23.188460 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-15658011-6bfe-445f-a9a3-9030055677da None None] Port 25dca142-5ab7-4214-a502-7b78c0f77cd2 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:20:23.196291 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:20:23.205326 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] 10.222.0.74 "PUT /v2.0/routers/a59f8c59-1a3a-4919-8e53-9db5a22f8dde/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5810413
Jun 01 11:20:23.721298 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39974) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:23.727513 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-948886587-network', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:23.732328 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:23.736199 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Usage tracker for resource:network and tenant:b0898f5cd58046c4a3a5343c0ec03baf is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:23.739781 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:23.745471 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:23.756340 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Made reservation on behalf of b0898f5cd58046c4a3a5343c0ec03baf for: {'network': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:20:23.758697 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-4112406'] for network, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:23.771294 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Notify callbacks [] for security_group, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:23.785863 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:23.793561 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Usage tracker for resource:security_group_rule and tenant:b0898f5cd58046c4a3a5343c0ec03baf is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:23.793561 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:23.798137 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:23.880693 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:23.884747 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:23.887808 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9f8c3f9a-181c-4745-8fe1-0e9cea86e746 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:23.917395 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 678}  {{(pid=119240) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 11:20:23.926200 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb46adb9-7ae8-4f09-ba63-739534fe7c3a,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:23.929765 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:23.932765 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:23.933136 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.segments_db [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Added segment 5067a62f-c732-4b9f-8f48-d348815b4148 of type vlan for network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78
Jun 01 11:20:23.966263 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750888230741'] for network, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:23.996117 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954'] for network, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:23.997420 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:23.997996 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:24.001326 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7afd434b-2fd5-4bc1-89af-34b84ec893b8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:24.104272 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] 10.222.0.74 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.3818789
Jun 01 11:20:24.105163 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Pushing event updated for resources: {'Network': ['ID=7fab40d6-3e77-414f-b4ba-e1447d0e6e78,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:24.107285 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39978) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:24.109662 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:24.113227 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Request body: {'subnet': {'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-948886587-subnet', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'ip_version': 4}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:24.117964 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 details requested by agent ovs-agent-dv-cinder-787764-3-iscsi with host dv-cinder-787764-3-iscsi {{(pid=119242) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 11:20:24.118472 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:24.122047 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Usage tracker for resource:subnet and tenant:b0898f5cd58046c4a3a5343c0ec03baf is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:24.124957 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:24.130661 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:24.145223 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Made reservation on behalf of b0898f5cd58046c4a3a5343c0ec03baf for: {'subnet': 1} {{(pid=119240) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:20:24.147616 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-11313286'] for subnet, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:24.208718 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Sync routers for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:20:24.218826 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:24.219574 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57981721c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:19:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:24.399555 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:24.527117 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10700502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-11313296'] for subnet, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:24.531821 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-d1c4c13e-21af-4693-892f-8704d4d05aea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:24.671753 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:24.709661 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Pushing event updated for resources: {'Subnet': ['ID=8bc83fa9-97e8-499c-895a-f82b2a17fdac,revision_number=0']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:24.713016 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:24.719359 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Checking segment: {'id': '5067a62f-c732-4b9f-8f48-d348815b4148', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119240) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:20:24.719757 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Network hostable DHCP agents. Network: 7fab40d6-3e77-414f-b4ba-e1447d0e6e78, hostable agents: ['4c839974-ab01-44ba-977c-3365ce6a0b98'], hosted agents: [] {{(pid=119240) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 11:20:24.733247 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57981721c0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 2, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:24.737237 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Checking router: a59f8c59-1a3a-4919-8e53-9db5a22f8dde for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:20:24.737606 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Updating router a59f8c59-1a3a-4919-8e53-9db5a22f8dde port 25dca142-5ab7-4214-a502-7b78c0f77cd2 binding host dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:20:24.740484 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 is scheduled to be hosted by DHCP agent 4c839974-ab01-44ba-977c-3365ce6a0b98 with binding_index 1 {{(pid=119240) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 11:20:24.746721 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:24.750925 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-3-iscsi, 7fab40d6-3e77-414f-b4ba-e1447d0e6e78) {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:24.751511 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:24.751952 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:24.760647 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:24.761097 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:24.787753 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7ff8d843-c31a-437e-b958-6c0ad93be32d admin admin] 10.222.0.74 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 0.6757836
Jun 01 11:20:24.787966 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39982) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:24.789331 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33adcb10-31c0-485d-9f7d-0ef32f8f8097 None None] Network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:20:24.793409 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:24.797287 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:24.798045 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:24.802391 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Usage tracker for resource:router and tenant:b0898f5cd58046c4a3a5343c0ec03baf is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:24.805264 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:24.810875 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:24.822068 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-643295', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4000'] for router, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:24.823030 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-645087', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-645120', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-994029', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4011'] for router, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:24.838850 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.024649 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.080146 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=55efbe93-08e3-4768-ac7b-d48d5ea5bb31,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:25.085384 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.087404 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-55429625-eec9-452c-8080-e8afbd45ccd6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:25.110462 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-645157', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-643309', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4061'] for router, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.122371 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp9ce9fb64-9105-571d-80d5-c4e05b9216b9-7fab40d6-3e77-414f-b4ba-e1447d0e6e78', 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'fixed_ips': [{'subnet_id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac'}]}} from dv-cinder-787764-3-iscsi. {{(pid=119242) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 11:20:25.123178 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.181789 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Notify callbacks [] for port, precommit_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.194263 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.provisioning_blocks [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Transition to ACTIVE for port object 25dca142-5ab7-4214-a502-7b78c0f77cd2 will not be triggered until provisioned by entity L2. {{(pid=119243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:25.201804 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.211931 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-bf2bbd76-92d4-48ba-9911-c7c8f04a3a7b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:25.227417 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=55efbe93-08e3-4768-ac7b-d48d5ea5bb31,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:25.242597 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:25.311499 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.db_base_plugin_common [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Allocated IP 172.20.0.2 (7fab40d6-3e77-414f-b4ba-e1447d0e6e78/8bc83fa9-97e8-499c-895a-f82b2a17fdac/6df9bb0c-22b5-4cf7-a92c-bf9e126a1682) {{(pid=119242) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:20:25.413782 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Attempting to bind port 25dca142-5ab7-4214-a502-7b78c0f77cd2 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:20:25.414147 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Attempting to bind port 25dca142-5ab7-4214-a502-7b78c0f77cd2 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:20:25.414759 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Attempting to bind port 25dca142-5ab7-4214-a502-7b78c0f77cd2 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:20:25.422402 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 19, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:20:25.423054 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Checking segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:20:25.423682 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.424257 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Bound using segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:20:25.424888 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Bound port: 25dca142-5ab7-4214-a502-7b78c0f77cd2, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:20:25.425476 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.463120 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.498868 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.515955 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] For port 25dca142-5ab7-4214-a502-7b78c0f77cd2, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:20:25.519321 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] For port 25dca142-5ab7-4214-a502-7b78c0f77cd2, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=25dca142-5ab7-4214-a502-7b78c0f77cd2,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:20:25.523875 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Pushing event updated for resources: {'Port': ['ID=25dca142-5ab7-4214-a502-7b78c0f77cd2,revision_number=3']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:25.531659 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.531960 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.532298 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.532619 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.533162 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.533564 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.533784 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.534096 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.534635 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.535116 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.535343 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-dd004a48-3d36-4333-9f39-6a86c7576b72 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.535839 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.536336 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:20:25.539938 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.541049 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.329s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:25.544940 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:25.548462 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Notify callbacks [] for port, precommit_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.562211 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Transition to ACTIVE for port object 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:25.574578 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.587045 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Transition to ACTIVE for port object 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 will not be triggered until provisioned by entity DHCP. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:25.594213 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667'] for port, after_create {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.598462 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:25.617982 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Pushing event updated for resources: {'Port': ['ID=25dca142-5ab7-4214-a502-7b78c0f77cd2,revision_number=4']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:25.642882 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:25.643514 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57981721c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:20:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:25.657437 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 is already hosted by enough agents. {{(pid=119242) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:20:25.660452 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.scheduler.base_scheduler [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Resources bound (agent type, host, resource id):  {{(pid=119242) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:25.664178 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Received port after_create {{(pid=119242) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:20:25.694558 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Allocated IP 172.27.3.172 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/722afba1-9696-48e5-9935-e00a37635c9d) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:20:25.711177 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Pushing event updated for resources: {'Port': ['ID=6df9bb0c-22b5-4cf7-a92c-bf9e126a1682,revision_number=1']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:25.718166 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:25.770500 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Attempting to bind port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:20:25.770871 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Attempting to bind port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '5067a62f-c732-4b9f-8f48-d348815b4148', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:20:25.771441 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Attempting to bind port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 on network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:20:25.777448 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 20, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:20:25.778071 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Checking segment: {'id': '5067a62f-c732-4b9f-8f48-d348815b4148', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:20:25.778638 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.779197 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Bound using segment: {'id': '5067a62f-c732-4b9f-8f48-d348815b4148', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:20:25.779864 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Bound port: 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5067a62f-c732-4b9f-8f48-d348815b4148', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:20:25.780417 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.851931 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-69da4a9a-cb16-424a-8295-63dc6bc80b22 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.307s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:25.853637 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:25.873732 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] For port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:20:25.877116 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] For port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=6df9bb0c-22b5-4cf7-a92c-bf9e126a1682,segment=NetworkSegment(5067a62f-c732-4b9f-8f48-d348815b4148),segment_id=5067a62f-c732-4b9f-8f48-d348815b4148)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:20:25.881835 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.886978 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-53e28ec6-8fe4-4bc5-8d0c-712638befff5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:25.890796 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.925042 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:25.932437 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-46959086-cc7e-443a-8d07-84b233a4f5fc tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:25.996269 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:20:25.999032 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:26.002900 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:20:26.016059 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Pushing event updated for resources: {'Port': ['ID=6df9bb0c-22b5-4cf7-a92c-bf9e126a1682,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:26.019061 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:26.048972 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Pushing event updated for resources: {'Port': ['ID=722afba1-9696-48e5-9935-e00a37635c9d,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:26.053055 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:26.232764 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57981721c0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:26.236800 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a176a1-9d5b-4a2a-8174-35f5b67b679c None None] The sync data for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi is: [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:20:26.442456 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:26.585466 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:26.780172 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 25dca142-5ab7-4214-a502-7b78c0f77cd2 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:26.867343 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 25dca142-5ab7-4214-a502-7b78c0f77cd2 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:26.872899 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 25dca142-5ab7-4214-a502-7b78c0f77cd2 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:26.873219 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:27.001821 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:27.002834 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-643286', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-645222'] for router, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:27.028170 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-334201cc-5c26-429d-b107-af0877aa665d None None] Network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:20:27.147334 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 25dca142-5ab7-4214-a502-7b78c0f77cd2, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=25dca142-5ab7-4214-a502-7b78c0f77cd2,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:27.148474 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-064123c7-7d83-4c8d-8466-4c9275e2020c None None] Provisioning for port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:27.157986 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:27.158834 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:27.189267 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:27.224314 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 is scheduled to L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e with binding_index 1 {{(pid=119240) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 11:20:27.344302 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=25dca142-5ab7-4214-a502-7b78c0f77cd2,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:27.348790 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:27.406897 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:27.415572 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:20:27.417852 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:27.418249 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:27.441077 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:27.442300 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] 10.222.0.74 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 2.6533439
Jun 01 11:20:27.445356 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 39988) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:27.455743 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Sync routers for ids ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:20:27.496845 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Routers {'81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:27.497469 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579867f610>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:20:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:27.739919 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:27.754923 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Set router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:27.973803 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:27.988329 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=6df9bb0c-22b5-4cf7-a92c-bf9e126a1682,segment=NetworkSegment(5067a62f-c732-4b9f-8f48-d348815b4148),segment_id=5067a62f-c732-4b9f-8f48-d348815b4148)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:27.997348 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:27.998186 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:28.023809 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:28.096221 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-48707258-1fe0-4a4c-90a0-05b1af97b90b None None] Provisioning complete for port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:28.096596 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-48707258-1fe0-4a4c-90a0-05b1af97b90b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:28.244209 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:28.283879 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=6df9bb0c-22b5-4cf7-a92c-bf9e126a1682,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:28.287101 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:28.310907 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:28.311286 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:28.437229 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579867f610>, [{'id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '722afba1-9696-48e5-9935-e00a37635c9d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:24Z', 'updated_at': '2021-06-01T11:20:26Z', 'revision_number': 3, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'gw_port': {'id': '722afba1-9696-48e5-9935-e00a37635c9d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:dd:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:25Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:28.451721 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Allocated IP 172.20.0.1 (7fab40d6-3e77-414f-b4ba-e1447d0e6e78/8bc83fa9-97e8-499c-895a-f82b2a17fdac/0a49873a-c8d9-47b7-b05f-fd20555fff3c) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:20:28.468981 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Checking router: 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:20:28.469553 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Updating router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 port 722afba1-9696-48e5-9935-e00a37635c9d binding host dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:20:28.539869 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:28.602170 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:28.619687 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.provisioning_blocks [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Transition to ACTIVE for port object 0a49873a-c8d9-47b7-b05f-fd20555fff3c will not be triggered until provisioned by entity DHCP. {{(pid=119240) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:28.648065 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:28.652896 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-40c446b1-0e75-4c8f-a493-ebb58756f393 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:28.653964 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 25dca142-5ab7-4214-a502-7b78c0f77cd2 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:28.711056 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:20:28.713936 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:28.717607 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:20:28.767932 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Pushing event updated for resources: {'Port': ['ID=0a49873a-c8d9-47b7-b05f-fd20555fff3c,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:28.772226 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:28.785041 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-925975'] for router_interface, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:28.834908 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 25dca142-5ab7-4214-a502-7b78c0f77cd2 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:28.835298 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:28.910019 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.039871 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-fee63c08-1385-4be6-a76e-191c93dd5049 None None] Provisioning for port 0a49873a-c8d9-47b7-b05f-fd20555fff3c completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:29.059246 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-fee63c08-1385-4be6-a76e-191c93dd5049 None None] Provisioning complete for port 0a49873a-c8d9-47b7-b05f-fd20555fff3c triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:29.059548 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-fee63c08-1385-4be6-a76e-191c93dd5049 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.085117 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Notify callbacks [] for port, precommit_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.104263 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:29.132159 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.136583 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.162014 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Transition to ACTIVE for port object 722afba1-9696-48e5-9935-e00a37635c9d will not be triggered until provisioned by entity L2. {{(pid=119242) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:29.164217 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f3bd0f86-9404-46c5-86bc-c648483a27b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:29.179517 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.185607 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-0ee9298d-a8de-417f-a512-838aa3d776fd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:29.220667 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-fee63c08-1385-4be6-a76e-191c93dd5049 None None] Port 0a49873a-c8d9-47b7-b05f-fd20555fff3c cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:20:29.243238 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-532992', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-926138'] for router_interface, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.252030 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Pushing event updated for resources: {'Port': ['ID=0a49873a-c8d9-47b7-b05f-fd20555fff3c,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:29.256502 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:29.270973 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Attempting to bind port 722afba1-9696-48e5-9935-e00a37635c9d on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:20:29.271265 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Attempting to bind port 722afba1-9696-48e5-9935-e00a37635c9d by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:20:29.271697 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Attempting to bind port 722afba1-9696-48e5-9935-e00a37635c9d on network 75238de6-1437-4113-aa89-3deeb50d4603 {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:20:29.276553 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c15c5a4c-db3b-4079-ae12-b664dd7686f2 None None] Pushing event updated for resources: {'Port': ['ID=722afba1-9696-48e5-9935-e00a37635c9d,revision_number=2']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:29.281861 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-c15c5a4c-db3b-4079-ae12-b664dd7686f2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:29.282919 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 20, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:20:29.283293 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Checking segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119242) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:20:29.283743 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.284137 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Bound using segment: {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'} {{(pid=119242) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:20:29.284757 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.managers [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Bound port: 722afba1-9696-48e5-9935-e00a37635c9d, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abf878e1-d747-4b28-bf0b-78bc0965f02b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603'}}] {{(pid=119242) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:20:29.285149 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.331107 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:29.331432 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.384633 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:20:29.385784 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:29.413222 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] For port 722afba1-9696-48e5-9935-e00a37635c9d, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119242) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:20:29.416710 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] For port 722afba1-9696-48e5-9935-e00a37635c9d, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=722afba1-9696-48e5-9935-e00a37635c9d,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:20:29.424461 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.430292 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-22e38e4e-4c53-424a-97c2-5f83a66839f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:29.569743 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c15c5a4c-db3b-4079-ae12-b664dd7686f2 None None] Pushing event updated for resources: {'Port': ['ID=722afba1-9696-48e5-9935-e00a37635c9d,revision_number=3']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:29.573791 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-c15c5a4c-db3b-4079-ae12-b664dd7686f2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:29.575546 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Routers {'81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:29.576209 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579867f610>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:20:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:29.671032 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-0d70b28f-51d4-491f-a933-ffdd1ac5cd6f None None] Provisioning complete for port 0a49873a-c8d9-47b7-b05f-fd20555fff3c triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:29.671332 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-0d70b28f-51d4-491f-a933-ffdd1ac5cd6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:29.689251 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:20:29.798097 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-0d70b28f-51d4-491f-a933-ffdd1ac5cd6f None None] Port 0a49873a-c8d9-47b7-b05f-fd20555fff3c cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:20:29.809000 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] Set router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:29.871497 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:20:29.880325 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] 10.222.0.74 "PUT /v2.0/routers/81cd47a2-af4e-4f4e-87fa-f2733c4a3f78/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4339831
Jun 01 11:20:30.173281 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579867f610>, [{'id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '722afba1-9696-48e5-9935-e00a37635c9d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:24Z', 'updated_at': '2021-06-01T11:20:28Z', 'revision_number': 4, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'gw_port': {'id': '722afba1-9696-48e5-9935-e00a37635c9d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:dd:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:25Z', 'updated_at': '2021-06-01T11:20:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '0a49873a-c8d9-47b7-b05f-fd20555fff3c', 'name': '', 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'mac_address': 'fa:16:3e:90:41:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:28Z', 'updated_at': '2021-06-01T11:20:28Z', 'revision_number': 2, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'subnets': [{'id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:30.178093 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07ea6f37-c004-43b0-aff6-b9520b977397 None None] The sync data for ids ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'] in dv-cinder-787764-3-iscsi is: [{'id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '722afba1-9696-48e5-9935-e00a37635c9d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:24Z', 'updated_at': '2021-06-01T11:20:28Z', 'revision_number': 4, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'gw_port': {'id': '722afba1-9696-48e5-9935-e00a37635c9d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:dd:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:25Z', 'updated_at': '2021-06-01T11:20:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '0a49873a-c8d9-47b7-b05f-fd20555fff3c', 'name': '', 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'mac_address': 'fa:16:3e:90:41:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:28Z', 'updated_at': '2021-06-01T11:20:28Z', 'revision_number': 2, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'subnets': [{'id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:20:30.430368 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 39998) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:30.435880 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1843123992', 'description': 'tempest-secgroup-smoke-1843123992 description', 'project_id': '858ec485cd65427ca55a7bbfe0be5efe'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:30.442442 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:30.447182 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:security_group and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:30.450303 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:30.457680 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:30.468164 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.490124 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:30.494172 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:security_group_rule and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:30.497292 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:30.503173 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:30.575621 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.579730 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.583758 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-e179616e-9f71-4493-8e96-46efb6022908 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:30.624151 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'SecurityGroup': ['ID=647a42bf-905f-496c-95f8-7c300a6ee43c,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:30.627044 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:30.631652 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.632855 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-443af2a0-acdf-4245-a62c-c3d513e6b999 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.2014565
Jun 01 11:20:30.635846 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40002) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:30.641039 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'security_group_rule': {'security_group_id': '647a42bf-905f-496c-95f8-7c300a6ee43c', 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:30.648180 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:30.652142 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:security_group_rule and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:30.655047 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:30.661839 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:30.678476 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.756442 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.761368 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.763462 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:30.782994 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c3ecd94a-bac0-44d5-a801-ba50091d74be,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:30.787178 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:30.803281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.804591 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-82da1f20-374e-43cd-9319-796dec9d6e57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1677973
Jun 01 11:20:30.807374 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40006) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:30.813229 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'security_group_rule': {'security_group_id': '647a42bf-905f-496c-95f8-7c300a6ee43c', 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:30.819753 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:30.824003 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:security_group_rule and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:30.827180 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:30.834531 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:30.852748 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.919107 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.924009 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.926123 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:30.948714 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c827129a-d12d-4e97-8bdd-d0dbb33f044a,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:30.951259 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:30.959694 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:30.961185 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-026c6929-35c1-470c-a4ae-6759d4379054 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1525381
Jun 01 11:20:30.963875 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40010) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:30.969031 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'security_group_rule': {'security_group_id': '647a42bf-905f-496c-95f8-7c300a6ee43c', 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:30.975925 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:30.979999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:security_group_rule and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:30.983056 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:30.988932 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:31.005887 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.073160 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.076998 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.079145 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5590b6d8-b5c6-406f-b2f2-43446c5440e2 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:31.103554 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=61f8d19e-0f5d-4f37-a129-d3501f5f60ce,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:31.108191 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:31.112677 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.114134 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-092e2129-9dfa-42c0-b8bd-ba9a75a56691 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1493404
Jun 01 11:20:31.116766 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40014) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:31.121929 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'security_group_rule': {'security_group_id': '647a42bf-905f-496c-95f8-7c300a6ee43c', 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:31.128043 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:31.132563 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:security_group_rule and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:31.135465 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:31.141360 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:31.162990 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.229917 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.234652 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.236796 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:31.259866 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bf2e7ae7-f272-4e7a-b6b5-e2fb14bf7f56,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:31.262541 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:31.271008 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.272238 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-42adc3b1-cdbc-4e5c-b4ea-549632efe76e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1545303
Jun 01 11:20:31.274921 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40018) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:31.280253 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'security_group_rule': {'security_group_id': '647a42bf-905f-496c-95f8-7c300a6ee43c', 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:31.286877 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:31.290929 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:security_group_rule and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:31.293901 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:31.299662 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:31.311048 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.securitygroups_db [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Project 858ec485cd65427ca55a7bbfe0be5efe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 11:20:31.317623 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.381572 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.385058 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.386980 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:31.408528 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=262ef910-09a8-474a-a702-a3db97e8776e,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:31.410872 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:31.417290 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.418694 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-f56e2a73-87fa-4dd5-b687-aafd6bfbaab6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1428533
Jun 01 11:20:31.421342 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40022) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:20:31.426732 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'security_group_rule': {'security_group_id': '647a42bf-905f-496c-95f8-7c300a6ee43c', 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:31.432284 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:31.435997 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:security_group_rule and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:31.438792 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:31.445140 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:31.455672 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.securitygroups_db [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Project 858ec485cd65427ca55a7bbfe0be5efe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 11:20:31.461350 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.528722 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.532323 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985735'] for security_group_rule, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.534378 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:31.556689 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a77c4ce7-e80b-4442-a9aa-a046884d01cc,revision_number=0']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:31.560977 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:31.565144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group_rule, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:31.566874 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0a0c4bbc-cce0-42a0-9f97-6be4d128da32 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1446378
Jun 01 11:20:32.655202 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 722afba1-9696-48e5-9935-e00a37635c9d up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:32.724986 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 722afba1-9696-48e5-9935-e00a37635c9d completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:32.730080 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 722afba1-9696-48e5-9935-e00a37635c9d triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:32.730452 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:32.854894 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:32.873256 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 722afba1-9696-48e5-9935-e00a37635c9d, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=722afba1-9696-48e5-9935-e00a37635c9d,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:32.877280 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:32.879723 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-c15c5a4c-db3b-4079-ae12-b664dd7686f2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:32.944488 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=722afba1-9696-48e5-9935-e00a37635c9d,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:32.947427 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:33.798491 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Sync routers for ids ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:20:33.806542 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:20:33.812068 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Routers {'81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:33.812694 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579914d430>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:20:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:33.994752 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Set router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:34.328845 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579914d430>, [{'id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '722afba1-9696-48e5-9935-e00a37635c9d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:24Z', 'updated_at': '2021-06-01T11:20:28Z', 'revision_number': 4, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'gw_port': {'id': '722afba1-9696-48e5-9935-e00a37635c9d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:dd:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:25Z', 'updated_at': '2021-06-01T11:20:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '0a49873a-c8d9-47b7-b05f-fd20555fff3c', 'name': '', 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'mac_address': 'fa:16:3e:90:41:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:28Z', 'updated_at': '2021-06-01T11:20:28Z', 'revision_number': 2, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'subnets': [{'id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:34.333423 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Checking router: 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:20:34.333785 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Updating router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 port 0a49873a-c8d9-47b7-b05f-fd20555fff3c binding host dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 11:20:34.388069 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:34.641096 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 722afba1-9696-48e5-9935-e00a37635c9d up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:34.716129 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 722afba1-9696-48e5-9935-e00a37635c9d triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:34.716507 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:34.729296 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Notify callbacks [] for port, precommit_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:34.740853 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.provisioning_blocks [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Transition to ACTIVE for port object 0a49873a-c8d9-47b7-b05f-fd20555fff3c will not be triggered until provisioned by entity L2. {{(pid=119243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:34.747862 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:34.752327 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:34.869263 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36289c17-1413-4ed4-b055-61a3640be4e5 None None] Pushing event updated for resources: {'Port': ['ID=0a49873a-c8d9-47b7-b05f-fd20555fff3c,revision_number=3']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:34.875802 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-36289c17-1413-4ed4-b055-61a3640be4e5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:34.989663 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Attempting to bind port 0a49873a-c8d9-47b7-b05f-fd20555fff3c on host dv-cinder-787764-3-iscsi for vnic_type normal with profile  {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:20:34.990085 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Attempting to bind port 0a49873a-c8d9-47b7-b05f-fd20555fff3c by drivers openvswitch,hyperv on host dv-cinder-787764-3-iscsi at level 0 using segments [{'id': '5067a62f-c732-4b9f-8f48-d348815b4148', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78'}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:20:34.990461 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Attempting to bind port 0a49873a-c8d9-47b7-b05f-fd20555fff3c on network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:20:34.997793 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Checking agent: {'id': 'd0f625e8-323d-4ec9-b18b-e3ca7abbf3cc', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 1, 25), 'started_at': datetime.datetime(2021, 6, 1, 11, 1, 55), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 20, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:20:34.998227 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Checking segment: {'id': '5067a62f-c732-4b9f-8f48-d348815b4148', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:20:34.998653 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:34.999200 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Bound using segment: {'id': '5067a62f-c732-4b9f-8f48-d348815b4148', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78'} {{(pid=119243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:20:34.999812 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.managers [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Bound port: 0a49873a-c8d9-47b7-b05f-fd20555fff3c, host: dv-cinder-787764-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5067a62f-c732-4b9f-8f48-d348815b4148', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78'}}] {{(pid=119243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:20:35.000236 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:35.088298 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] For port 0a49873a-c8d9-47b7-b05f-fd20555fff3c, host dv-cinder-787764-3-iscsi, cleared binding levels {{(pid=119243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:20:35.091104 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.plugins.ml2.db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] For port 0a49873a-c8d9-47b7-b05f-fd20555fff3c, host dv-cinder-787764-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=0a49873a-c8d9-47b7-b05f-fd20555fff3c,segment=NetworkSegment(5067a62f-c732-4b9f-8f48-d348815b4148),segment_id=5067a62f-c732-4b9f-8f48-d348815b4148)] {{(pid=119243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:20:35.095658 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron_lib.callbacks.manager [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:35.099913 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:35.180220 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Routers {'81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:20:35.180855 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579914d430>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:20:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:35.228968 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36289c17-1413-4ed4-b055-61a3640be4e5 None None] Pushing event updated for resources: {'Port': ['ID=0a49873a-c8d9-47b7-b05f-fd20555fff3c,revision_number=4']} {{(pid=119243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:35.236953 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG oslo_concurrency.lockutils [None req-36289c17-1413-4ed4-b055-61a3640be4e5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=119243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:35.364472 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] Set router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:20:35.705826 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579914d430>, [{'id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '722afba1-9696-48e5-9935-e00a37635c9d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:24Z', 'updated_at': '2021-06-01T11:20:28Z', 'revision_number': 4, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'gw_port': {'id': '722afba1-9696-48e5-9935-e00a37635c9d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:dd:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:25Z', 'updated_at': '2021-06-01T11:20:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '0a49873a-c8d9-47b7-b05f-fd20555fff3c', 'name': '', 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'mac_address': 'fa:16:3e:90:41:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:28Z', 'updated_at': '2021-06-01T11:20:35Z', 'revision_number': 4, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'subnets': [{'id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:20:35.709836 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26ccf7af-e62f-4f78-8cfe-9ba516c0417c None None] The sync data for ids ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'] in dv-cinder-787764-3-iscsi is: [{'id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '722afba1-9696-48e5-9935-e00a37635c9d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:24Z', 'updated_at': '2021-06-01T11:20:28Z', 'revision_number': 4, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'gw_port': {'id': '722afba1-9696-48e5-9935-e00a37635c9d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:dd:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:25Z', 'updated_at': '2021-06-01T11:20:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '0a49873a-c8d9-47b7-b05f-fd20555fff3c', 'name': '', 'network_id': '7fab40d6-3e77-414f-b4ba-e1447d0e6e78', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'mac_address': 'fa:16:3e:90:41:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:28Z', 'updated_at': '2021-06-01T11:20:35Z', 'revision_number': 4, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'subnets': [{'id': '8bc83fa9-97e8-499c-895a-f82b2a17fdac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:20:36.661543 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 0a49873a-c8d9-47b7-b05f-fd20555fff3c up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:36.728720 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning for port 0a49873a-c8d9-47b7-b05f-fd20555fff3c completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:36.733283 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 0a49873a-c8d9-47b7-b05f-fd20555fff3c triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:36.733654 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:36.854350 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:36.887979 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] For port 0a49873a-c8d9-47b7-b05f-fd20555fff3c, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=0a49873a-c8d9-47b7-b05f-fd20555fff3c,segment=NetworkSegment(5067a62f-c732-4b9f-8f48-d348815b4148),segment_id=5067a62f-c732-4b9f-8f48-d348815b4148)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:20:36.892070 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:36.894310 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:36.960178 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Pushing event updated for resources: {'Port': ['ID=0a49873a-c8d9-47b7-b05f-fd20555fff3c,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:36.963170 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:38.647278 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 0a49873a-c8d9-47b7-b05f-fd20555fff3c up at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:20:38.717957 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Provisioning complete for port 0a49873a-c8d9-47b7-b05f-fd20555fff3c triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:38.718609 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:46.787262 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:47.724530 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-89535f02-a958-486c-b159-e0a89bb236f1 req-16963dd7-c9da-4f56-874b-e2b5d72e4547 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Synchronizing usage tracker for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:security_group {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:20:47.740513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-89535f02-a958-486c-b159-e0a89bb236f1 req-16963dd7-c9da-4f56-874b-e2b5d72e4547 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Unset dirty status for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:security_group {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:20:47.741940 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-16963dd7-c9da-4f56-874b-e2b5d72e4547 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1843123992&fields=id&tenant_id=858ec485cd65427ca55a7bbfe0be5efe HTTP/1.1" status: 200  len: 267 time: 0.0606256
Jun 01 11:20:47.891288 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89535f02-a958-486c-b159-e0a89bb236f1 req-937f395e-b513-441b-b776-a46dc1f46163 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:47.892136 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-89535f02-a958-486c-b159-e0a89bb236f1 req-937f395e-b513-441b-b776-a46dc1f46163 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Synchronizing usage tracker for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:network {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:20:47.908249 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-89535f02-a958-486c-b159-e0a89bb236f1 req-937f395e-b513-441b-b776-a46dc1f46163 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Unset dirty status for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:network {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:20:47.909356 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-937f395e-b513-441b-b776-a46dc1f46163 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 812 time: 0.1609874
Jun 01 11:20:47.923538 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-9ee91e45-1c42-4f30-9d5e-3533100063f4 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/quotas/858ec485cd65427ca55a7bbfe0be5efe HTTP/1.1" status: 200  len: 375 time: 0.0088201
Jun 01 11:20:48.006731 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-bf7221ae-bdd1-4242-85e7-31c3752f7171 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0777190
Jun 01 11:20:48.117100 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-5fcfc592-c1a6-4758-b554-06d99e57aa5a service neutron] http://10.222.0.74:9696/v2.0/extensions returned with HTTP 200 {{(pid=119241) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 11:20:48.118087 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-5fcfc592-c1a6-4758-b554-06d99e57aa5a service neutron] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1004426
Jun 01 11:20:48.246787 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-9c3621fc-1eb8-4522-a8ac-ca2f2c232594 service neutron] 10.222.0.74 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1228039
Jun 01 11:20:48.377389 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-e92c16ba-d736-4bca-bb94-49cb69f90438 service neutron] 10.222.0.74 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1248968
Jun 01 11:20:48.761500 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-dc714e83-55e6-47f5-8aca-160d1fab3f4e req-7db09e3f-8d17-4a0a-9f7a-df87b7c9988e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 210 time: 0.0459778
Jun 01 11:20:49.862503 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c4d209a7-ae64-4746-b9c7-57232bab8d1b req-a32bc8d9-0d53-4abb-95e1-31c6a3f3118e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 210 time: 0.0426323
Jun 01 11:20:50.957852 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-405e4521-f084-4eaf-931e-a3e710582cd7 req-515dd9f6-4a84-4b84-b361-74f2561b7a40 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 210 time: 0.0432062
Jun 01 11:20:52.150606 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a673fd52-a0a4-413c-8ca9-d18e68d81d88 req-d6906c07-db3f-46b9-ac93-1d0ff52098ff tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 210 time: 0.1421068
Jun 01 11:20:52.722566 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b8b852cf-80ff-41e4-b779-f00de27983c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:53.294781 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8bffd22f-0ad9-4363-a3e5-492ea54ea65c req-2f82f9a8-d18d-49a6-b6cf-7e18f80fda54 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 210 time: 0.0424232
Jun 01 11:20:54.017879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89535f02-a958-486c-b159-e0a89bb236f1 req-65018c91-d36b-4595-9828-ecca5d5d0352 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:54.019295 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-65018c91-d36b-4595-9828-ecca5d5d0352 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 812 time: 0.1472383
Jun 01 11:20:54.066499 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-70450577-e308-4359-9b48-16522152569d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=858ec485cd65427ca55a7bbfe0be5efe HTTP/1.1" status: 200  len: 380 time: 0.0394402
Jun 01 11:20:54.078062 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'port': {'device_id': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'admin_state_up': True, 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'security_groups': ['647a42bf-905f-496c-95f8-7c300a6ee43c']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:54.216082 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:20:54.219906 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:port and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:20:54.222846 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for port was recalculated. Used quota:2. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:20:54.228745 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:20:54.238057 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Made reservation on behalf of 858ec485cd65427ca55a7bbfe0be5efe for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:20:54.241587 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:54.456043 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8cc777fa-902d-421e-8b08-667371d6641f req-634dcf2d-83b5-44d0-842f-360d4e8abc7d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 210 time: 0.0539272
Jun 01 11:20:54.457067 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Allocated IP 172.20.0.7 (8234ed64-9e09-4fc8-a5b1-b67ff870ca9e/241dacc7-1074-4a81-a1a4-074010054ea6/64b7f860-00fb-47f9-8576-ebc8396bf4e2) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:20:54.650934 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:54.670363 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Transition to ACTIVE for port object 64b7f860-00fb-47f9-8576-ebc8396bf4e2 will not be triggered until provisioned by entity DHCP. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:54.695040 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:54.700982 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:54.766481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:20:54.769711 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:20:54.773321 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:20:54.807211 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'Port': ['ID=64b7f860-00fb-47f9-8576-ebc8396bf4e2,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:54.814012 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:54.843359 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:54.843993 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:54.864700 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-58f8a4b1-8176-4e2e-8d18-539d854c22c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.7935827
Jun 01 11:20:54.875745 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Request body: {'port': {'device_id': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:20:54.988333 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:55.007815 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-603cea91-230f-48b7-90be-9e7161f26217 None None] Provisioning for port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:20:55.013285 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-603cea91-230f-48b7-90be-9e7161f26217 None None] Provisioning complete for port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:20:55.013660 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-603cea91-230f-48b7-90be-9e7161f26217 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:55.065793 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-603cea91-230f-48b7-90be-9e7161f26217 None None] Port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:20:55.258114 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-42503510-a32b-4941-85dd-25564d01d0f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:55.334240 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 64b7f860-00fb-47f9-8576-ebc8396bf4e2 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:20:55.341420 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:55.348567 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:55.356384 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Transition to ACTIVE for port object 64b7f860-00fb-47f9-8576-ebc8396bf4e2 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:20:55.359817 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:55.364144 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-b4afba8d-c936-4577-9ca8-35a58be5df80 tempest-AttachVolumeTestJSON-1473742266 tempest-AttachVolumeTestJSON-1473742266-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:55.513169 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Pushing event updated for resources: {'Port': ['ID=64b7f860-00fb-47f9-8576-ebc8396bf4e2,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:55.527410 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:55.749821 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Attempting to bind port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:20:55.750155 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Attempting to bind port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:20:55.750482 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Attempting to bind port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:20:55.757648 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:20:55.757965 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Attempting to bind port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:20:55.765462 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 20, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:20:55.765799 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Checking segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:20:55.766177 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Bound using segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:20:55.766599 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Bound port: 64b7f860-00fb-47f9-8576-ebc8396bf4e2, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:20:55.766940 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:55.787448 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abe0a123-26e7-4c32-83b9-8e3496f5f4db req-90f68706-63d4-459b-8df6-1dbea3e377d9 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:55.788171 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-abe0a123-26e7-4c32-83b9-8e3496f5f4db req-90f68706-63d4-459b-8df6-1dbea3e377d9 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Synchronizing usage tracker for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:20:55.850017 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-abe0a123-26e7-4c32-83b9-8e3496f5f4db req-90f68706-63d4-459b-8df6-1dbea3e377d9 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Unset dirty status for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:20:55.851197 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-abe0a123-26e7-4c32-83b9-8e3496f5f4db req-90f68706-63d4-459b-8df6-1dbea3e377d9 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 943 time: 0.2002475
Jun 01 11:20:55.900818 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] For port 64b7f860-00fb-47f9-8576-ebc8396bf4e2, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:20:55.914484 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-abe0a123-26e7-4c32-83b9-8e3496f5f4db req-9c52dfa2-0280-47ed-aa25-9a7529b28a4a tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0527687
Jun 01 11:20:55.915957 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] For port 64b7f860-00fb-47f9-8576-ebc8396bf4e2, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:20:55.920929 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:55.926735 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-06f2c11a-6b46-4d52-8904-c3b9bfae34b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:20:55.978076 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:55.978298 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:55.979930 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] 10.222.0.79 "PUT /v2.0/ports/64b7f860-00fb-47f9-8576-ebc8396bf4e2 HTTP/1.1" status: 200  len: 1093 time: 1.1079996
Jun 01 11:20:55.987628 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'tag': '64b7f860-00fb-47f9-8576-ebc8396bf4e2'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:20:55.989989 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb2d4e3f-1f58-43c1-b706-9188522970ab" -d '{"events": [{"name": "network-changed", "server_uuid": "6edb6cbe-0e8f-42fa-9a41-cb2e8781f374", "tag": "64b7f860-00fb-47f9-8576-ebc8396bf4e2"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:20:56.015958 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Pushing event updated for resources: {'Port': ['ID=64b7f860-00fb-47f9-8576-ebc8396bf4e2,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:20:56.019688 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:20:56.054507 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:20:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b40c6972-f696-4fd2-8404-3b3a35b1d028 x-openstack-request-id: req-b40c6972-f696-4fd2-8404-3b3a35b1d028 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:20:56.054845 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6edb6cbe-0e8f-42fa-9a41-cb2e8781f374", "tag": "64b7f860-00fb-47f9-8576-ebc8396bf4e2", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:20:56.055141 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-b40c6972-f696-4fd2-8404-3b3a35b1d028 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:20:56.055572 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'tag': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'status': 'completed', 'code': 200}
Jun 01 11:20:56.099899 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89535f02-a958-486c-b159-e0a89bb236f1 req-bf4c9a27-2596-424e-9d4a-9f6ce497464e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:56.101451 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-bf4c9a27-2596-424e-9d4a-9f6ce497464e service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 1096 time: 0.0806057
Jun 01 11:20:56.174786 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-ee76e188-d811-4870-9eaa-9f399ed01871 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2 HTTP/1.1" status: 200  len: 217 time: 0.0665431
Jun 01 11:20:56.235420 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89535f02-a958-486c-b159-e0a89bb236f1 req-db59014a-e79d-4544-8277-383173d5487d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:56.236888 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-db59014a-e79d-4544-8277-383173d5487d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0562906
Jun 01 11:20:56.314119 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89535f02-a958-486c-b159-e0a89bb236f1 req-e4965704-1232-4ff8-82a6-001e3c4cf0c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:56.315494 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-e4965704-1232-4ff8-82a6-001e3c4cf0c5 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0726414
Jun 01 11:20:56.427092 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:56.446724 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-6d70489d-7549-4e26-a5f7-28e4545ae929 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1249263
Jun 01 11:20:56.575580 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-89535f02-a958-486c-b159-e0a89bb236f1 req-1f1f03c7-0c2a-407b-962e-9419d21733fe service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1225064
Jun 01 11:20:56.688387 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-b9a44a77-3ac5-4b1d-8b67-5858047d6457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:56.689792 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-b9a44a77-3ac5-4b1d-8b67-5858047d6457 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 1096 time: 0.0705895
Jun 01 11:20:56.821449 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-efc56c1c-9cc0-4948-8272-1ff996f72484 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:56.822871 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-efc56c1c-9cc0-4948-8272-1ff996f72484 service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1255374
Jun 01 11:20:56.893244 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-2ff5c1ea-195c-48af-8ce7-ff74e28ffd26 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2 HTTP/1.1" status: 200  len: 217 time: 0.0637531
Jun 01 11:20:56.954640 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-7daa71b9-ee9d-49ec-9e4b-998bb81beaeb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:56.956146 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-7daa71b9-ee9d-49ec-9e4b-998bb81beaeb service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0563517
Jun 01 11:20:57.085251 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-00a90770-e381-4add-a85e-e11e6a2bdc10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:57.086712 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-00a90770-e381-4add-a85e-e11e6a2bdc10 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1239400
Jun 01 11:20:57.191722 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6841513c-6f85-40b1-af5f-3cb33ea01df6 req-8693a6c2-eb7f-4771-9a22-4937d46f162d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:57.193662 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6841513c-6f85-40b1-af5f-3cb33ea01df6 req-8693a6c2-eb7f-4771-9a22-4937d46f162d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 943 time: 0.1710274
Jun 01 11:20:57.265926 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-af893799-7825-4ea2-a924-65ab35d37bd5 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1727834
Jun 01 11:20:57.270563 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6841513c-6f85-40b1-af5f-3cb33ea01df6 req-235a70f9-3ae9-4ab5-9644-4e7ef715aa20 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0701022
Jun 01 11:20:57.491297 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-cb2d4e3f-1f58-43c1-b706-9188522970ab req-1098739a-5bc7-425f-9422-89a1e2caa562 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2186651
Jun 01 11:20:57.771176 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:20:58.452281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2df193e-2759-483a-b4e8-dd3059d518b3 req-9f979db8-cba9-4e5f-8cfa-440308283e76 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:58.453711 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d2df193e-2759-483a-b4e8-dd3059d518b3 req-9f979db8-cba9-4e5f-8cfa-440308283e76 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 943 time: 0.0786619
Jun 01 11:20:58.497236 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d2df193e-2759-483a-b4e8-dd3059d518b3 req-6c165fae-6dd1-4046-af37-de402a986305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0379190
Jun 01 11:20:59.682016 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c85d36-3ba7-47b0-a0fc-93ec223e8faf req-8ea39487-d1c9-4495-973e-8b6daca21667 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:20:59.683467 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d6c85d36-3ba7-47b0-a0fc-93ec223e8faf req-8ea39487-d1c9-4495-973e-8b6daca21667 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 943 time: 0.0830665
Jun 01 11:20:59.727814 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d6c85d36-3ba7-47b0-a0fc-93ec223e8faf req-5e5c5a62-38cd-42ad-a173-8779864cd9c9 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385900
Jun 01 11:21:00.907073 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82107dfe-c723-488d-abc0-ea4087da1bdd req-21801f70-cb63-424a-8a0c-ec5a9edf5280 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:00.908527 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-82107dfe-c723-488d-abc0-ea4087da1bdd req-21801f70-cb63-424a-8a0c-ec5a9edf5280 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 943 time: 0.0779057
Jun 01 11:21:00.951863 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-82107dfe-c723-488d-abc0-ea4087da1bdd req-34823be4-82a8-4c8f-ad82-6d45c8c441c9 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377510
Jun 01 11:21:02.144732 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63dcdd61-6934-450f-9f03-15a458caf48d req-6a43d071-8b7c-43ec-af5f-84b467ce6da7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:02.146175 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-63dcdd61-6934-450f-9f03-15a458caf48d req-6a43d071-8b7c-43ec-af5f-84b467ce6da7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 943 time: 0.0886748
Jun 01 11:21:02.191309 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-63dcdd61-6934-450f-9f03-15a458caf48d req-d9ee4f5a-cccc-4317-bd84-afbeff65897d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390565
Jun 01 11:21:03.518273 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-833c6476-81b2-43c7-8bb6-54afb16b82ca req-777d4043-2914-4611-91b2-34c044dee3ff tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:03.519655 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-833c6476-81b2-43c7-8bb6-54afb16b82ca req-777d4043-2914-4611-91b2-34c044dee3ff tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 943 time: 0.0844152
Jun 01 11:21:03.563938 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-833c6476-81b2-43c7-8bb6-54afb16b82ca req-ac3d9c5e-d62f-4ecf-b762-445c7534d11e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0379713
Jun 01 11:21:03.977993 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 64b7f860-00fb-47f9-8576-ebc8396bf4e2 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:21:04.140398 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 64b7f860-00fb-47f9-8576-ebc8396bf4e2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:21:04.157196 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'port_id': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'mac_address': 'fa:16:3e:a3:91:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:21:04.210824 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:04.226878 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 64b7f860-00fb-47f9-8576-ebc8396bf4e2 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:21:04.241726 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 64b7f860-00fb-47f9-8576-ebc8396bf4e2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:21:04.245593 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:04.247281 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:21:04.311572 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=64b7f860-00fb-47f9-8576-ebc8396bf4e2,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:21:04.314592 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:21:04.451657 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['64b7f860-00fb-47f9-8576-ebc8396bf4e2'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:21:04.747470 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d879fb-2c19-46aa-b59f-6269a8782447 req-c299e62e-fb78-4b22-af0e-06ce89c867ce tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:04.748943 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a8d879fb-2c19-46aa-b59f-6269a8782447 req-c299e62e-fb78-4b22-af0e-06ce89c867ce tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 944 time: 0.0815284
Jun 01 11:21:04.792911 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a8d879fb-2c19-46aa-b59f-6269a8782447 req-75051d3e-0703-4ab6-8205-c879ec93a805 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382347
Jun 01 11:21:05.978771 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c0cc8a-23b5-468a-b165-0358d0255056 req-facba5a1-038b-44dd-8c27-0eecdceb5ecb tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:05.980194 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-86c0cc8a-23b5-468a-b165-0358d0255056 req-facba5a1-038b-44dd-8c27-0eecdceb5ecb tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 944 time: 0.0833466
Jun 01 11:21:05.981712 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 64b7f860-00fb-47f9-8576-ebc8396bf4e2 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:21:06.025732 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-86c0cc8a-23b5-468a-b165-0358d0255056 req-972d4761-fc21-4ed7-9c66-a1a3393a93c5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397909
Jun 01 11:21:06.048668 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:21:06.053135 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:21:06.053543 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:06.169730 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:06.195941 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64b7f860-00fb-47f9-8576-ebc8396bf4e2'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:21:06.198181 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2346e834-fa6c-4d27-b95b-831f066de42f" -d '{"events": [{"server_uuid": "6edb6cbe-0e8f-42fa-9a41-cb2e8781f374", "name": "network-vif-plugged", "status": "completed", "tag": "64b7f860-00fb-47f9-8576-ebc8396bf4e2"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:21:06.205818 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port 64b7f860-00fb-47f9-8576-ebc8396bf4e2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:21:06.209599 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:06.211473 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-9bcb326b-4d76-42d7-9300-48becb927602 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:21:06.280511 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=64b7f860-00fb-47f9-8576-ebc8396bf4e2,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:21:06.283531 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:21:06.292869 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:21:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59121470-8f57-4339-8e88-831eb444a326 x-openstack-request-id: req-59121470-8f57-4339-8e88-831eb444a326 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:21:06.293167 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6edb6cbe-0e8f-42fa-9a41-cb2e8781f374", "name": "network-vif-plugged", "status": "completed", "tag": "64b7f860-00fb-47f9-8576-ebc8396bf4e2", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:21:06.293430 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-59121470-8f57-4339-8e88-831eb444a326 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:21:06.293821 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'code': 200}
Jun 01 11:21:06.565148 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac73d7ee-343f-4ee2-a394-7a323857c659 req-eef5feb7-e8a4-4836-8252-1d2b400b36b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:06.566540 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ac73d7ee-343f-4ee2-a394-7a323857c659 req-eef5feb7-e8a4-4836-8252-1d2b400b36b3 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 1098 time: 0.0719652
Jun 01 11:21:06.605629 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ac73d7ee-343f-4ee2-a394-7a323857c659 req-3c5ed46f-390a-4b43-bfd6-4c712752691d service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0330489
Jun 01 11:21:07.212889 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5905df-b9c8-4e03-9576-a327d671cac0 req-fbb597e1-1c44-4a05-9280-cc5d99bf92d7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:07.214338 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bc5905df-b9c8-4e03-9576-a327d671cac0 req-fbb597e1-1c44-4a05-9280-cc5d99bf92d7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 945 time: 0.0826490
Jun 01 11:21:07.258809 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-bc5905df-b9c8-4e03-9576-a327d671cac0 req-6ccfea41-56f8-4eb5-9195-7736f380629d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386970
Jun 01 11:21:08.439015 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f896143-4d2b-402b-a3e8-52c5c89defd5 req-96ebda22-e5ef-4c14-9fd1-a0d516aa8c1f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:08.440472 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1f896143-4d2b-402b-a3e8-52c5c89defd5 req-96ebda22-e5ef-4c14-9fd1-a0d516aa8c1f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 945 time: 0.0800581
Jun 01 11:21:08.487031 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1f896143-4d2b-402b-a3e8-52c5c89defd5 req-edcfa314-ec5f-4820-b68e-fa730fc1e2a6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409706
Jun 01 11:21:08.668540 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-166495ab-6784-4235-ac24-ad20795539e6 req-8de35ecd-e38d-49cd-bad6-b959a5d0be8d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:08.669984 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-166495ab-6784-4235-ac24-ad20795539e6 req-8de35ecd-e38d-49cd-bad6-b959a5d0be8d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 945 time: 0.0798213
Jun 01 11:21:08.715695 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-166495ab-6784-4235-ac24-ad20795539e6 req-8a7314f8-321e-4c99-a760-e25872a89386 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399137
Jun 01 11:21:08.738354 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40208) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:21:08.851477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f391cb4-0cdd-4d83-b092-c20919976ce7 tempest-TestVolumeBootPattern-49478070 tempest-TestVolumeBootPattern-49478070-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:08.852879 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-0f391cb4-0cdd-4d83-b092-c20919976ce7 tempest-TestVolumeBootPattern-49478070 tempest-TestVolumeBootPattern-49478070-project-admin] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 1093 time: 0.1135955
Jun 01 11:21:08.855749 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40214) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:21:08.860579 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'floatingip': {'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'port_id': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address': '172.20.0.7'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:21:08.866219 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:21:08.869966 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:floatingip and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:21:08.872743 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:21:08.878306 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:21:08.888456 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:09.022981 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:09.152909 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Allocated IP 172.27.3.69 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/4f2b93bc-54e8-400e-a1f9-28f90d4d5cd6) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:21:09.297114 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:09.325406 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:09.330190 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-ce3b3702-3405-40e7-bdb6-f0f4415323bf tempest-AttachVolumeShelveTestJSON-512106060 tempest-AttachVolumeShelveTestJSON-512106060-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:21:09.486658 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:21:09.489567 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:21:09.493851 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:21:09.529849 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'Port': ['ID=4f2b93bc-54e8-400e-a1f9-28f90d4d5cd6,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:21:09.545788 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.546170 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.546546 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.546912 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.547275 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.547662 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.548027 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.548393 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.548752 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.549109 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.549463 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.549814 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:21:09.555250 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:21:09.914226 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:09.986973 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:10.198497 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:10.202802 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:10.207183 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:21:10.319599 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'Port': ['ID=4f2b93bc-54e8-400e-a1f9-28f90d4d5cd6,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:21:10.323715 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:21:10.328180 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:10.503360 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Floating IP 6763735a-69c2-4f00-b658-64aa60dec8e3 associated. External IP: 172.27.3.69, port: 64b7f860-00fb-47f9-8576-ebc8396bf4e2.
Jun 01 11:21:10.806493 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:21:10.848964 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Router a59f8c59-1a3a-4919-8e53-9db5a22f8dde has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:21:11.127208 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:21:11.137021 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] Sync routers for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:21:11.146460 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:21:11.147777 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5792f785e0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:20:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:21:11.151862 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:11.208687 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 2.3519373
Jun 01 11:21:11.209353 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'tag': '64b7f860-00fb-47f9-8576-ebc8396bf4e2'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:21:11.212171 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023" -d '{"events": [{"name": "network-changed", "server_uuid": "6edb6cbe-0e8f-42fa-9a41-cb2e8781f374", "tag": "64b7f860-00fb-47f9-8576-ebc8396bf4e2"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:21:11.253879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:21:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98f40ea4-48c0-4f80-bc93-5a5a7b760373 x-openstack-request-id: req-98f40ea4-48c0-4f80-bc93-5a5a7b760373 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:21:11.253879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6edb6cbe-0e8f-42fa-9a41-cb2e8781f374", "tag": "64b7f860-00fb-47f9-8576-ebc8396bf4e2", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:21:11.254195 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-98f40ea4-48c0-4f80-bc93-5a5a7b760373 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:21:11.254647 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'tag': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'status': 'completed', 'code': 200}
Jun 01 11:21:11.324610 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:21:11.345160 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-a5d88cda-70ba-4e85-84c6-35a6e5ae0c6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:11.346860 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-a5d88cda-70ba-4e85-84c6-35a6e5ae0c6b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 1098 time: 0.0710580
Jun 01 11:21:11.477068 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-17e9fe34-1789-4f85-93ea-58abbb7fc626 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:11.478514 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-17e9fe34-1789-4f85-93ea-58abbb7fc626 service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1254494
Jun 01 11:21:11.584319 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-679e07a9-a235-4dde-92c2-dabe77a27741 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2 HTTP/1.1" status: 200  len: 998 time: 0.0988083
Jun 01 11:21:11.650954 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-c60ddace-190a-4379-bda9-5035fc37c5fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:11.652405 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-c60ddace-190a-4379-bda9-5035fc37c5fb service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0614829
Jun 01 11:21:11.669893 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5792f785e0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '6763735a-69c2-4f00-b658-64aa60dec8e3', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.69', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:a3:91:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:21:09Z', 'updated_at': '2021-06-01T11:21:09Z', 'revision_number': 0, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:21:11.673725 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] Checking router: a59f8c59-1a3a-4919-8e53-9db5a22f8dde for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:21:11.682276 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:21:11.682905 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5792f785e0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:20:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:21:11.727312 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-7041467e-c799-4e38-b79c-e26b5b6c0d8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:11.728734 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-7041467e-c799-4e38-b79c-e26b5b6c0d8f service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0700829
Jun 01 11:21:11.863568 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-241f4697-47d1-4c4a-be1e-83c72e3a8171 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1268554
Jun 01 11:21:11.898512 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:21:11.995069 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-e63f4919-b7b6-4d3a-a2b7-e2e942d39023 req-70fe1d37-8ee1-4891-8c52-6472c5029600 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1247909
Jun 01 11:21:12.241233 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5792f785e0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '6763735a-69c2-4f00-b658-64aa60dec8e3', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.69', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:a3:91:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:21:09Z', 'updated_at': '2021-06-01T11:21:09Z', 'revision_number': 0, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:21:12.245187 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5109ac1b-429f-4082-8d0a-6ab319ec200a None None] The sync data for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi is: [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '6763735a-69c2-4f00-b658-64aa60dec8e3', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.69', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:a3:91:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:21:09Z', 'updated_at': '2021-06-01T11:21:09Z', 'revision_number': 0, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:21:12.514546 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d721d4-eaf9-453e-a337-fb9f195c9865 None None] New status for floating IP 6763735a-69c2-4f00-b658-64aa60dec8e3: ACTIVE {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:21:16.791023 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:18.664053 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-a2d65ce5-ebe7-48f2-ac11-64a8bca8e093 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0697279
Jun 01 11:21:18.804146 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-22e00870-a4bf-4dc1-b271-811cb81c31eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:18.805621 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-22e00870-a4bf-4dc1-b271-811cb81c31eb service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 1098 time: 0.0738029
Jun 01 11:21:18.953926 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-7c78dc90-5e79-41ad-ad2d-89da1b17a774 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:18.955527 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-7c78dc90-5e79-41ad-ad2d-89da1b17a774 service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1244838
Jun 01 11:21:19.056980 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-046e2c5c-5bbb-40bf-aade-00f1492a125b service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2 HTTP/1.1" status: 200  len: 1000 time: 0.0945940
Jun 01 11:21:19.121102 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-d648e123-fc58-471b-9486-4cd2129d9133 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:19.122536 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-d648e123-fc58-471b-9486-4cd2129d9133 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0591173
Jun 01 11:21:19.201096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-1ac6f9d2-c437-414d-9d54-c4200b63a336 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:21:19.202525 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-1ac6f9d2-c437-414d-9d54-c4200b63a336 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0721567
Jun 01 11:21:19.443664 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-2f06c7ce-d25a-4b55-857c-ffbf4cd0a635 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2340331
Jun 01 11:21:19.581944 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1d2a37e4-55e3-4526-925f-0f820a1f0b9c req-1da76396-34fa-4c46-97ac-44c1d6bd757b service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1306288
Jun 01 11:21:22.726094 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c8373207-37a0-4597-849f-81fe86e88d70 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:25.263222 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-8a6fb4d2-3b1e-4f3c-9a87-b63ddfdbf637 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:25.350820 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:26.429960 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:27.773185 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:46.820243 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:47.806054 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:21:52.727763 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-5e57c05c-b510-4211-987b-b3cf957dc72e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:55.255368 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a96bde25-150d-4fce-9053-27fd0fb77d5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:55.351827 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:56.433433 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:21:57.777222 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:16.839746 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:19.649443 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-a021bf08-f783-4dbe-89cd-9c2621301caf service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0691936
Jun 01 11:22:19.784245 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-205eb147-4b79-4aba-a8d4-4db0a4d6cb04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:22:19.785694 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-205eb147-4b79-4aba-a8d4-4db0a4d6cb04 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 1098 time: 0.0700309
Jun 01 11:22:19.932709 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-d752c09a-92db-46a0-861c-c860c032c5ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:22:19.934138 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-d752c09a-92db-46a0-861c-c860c032c5ae service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1293044
Jun 01 11:22:20.036873 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-a877a6d8-ef5b-4d25-8d25-23e0615ba193 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2 HTTP/1.1" status: 200  len: 1000 time: 0.0956070
Jun 01 11:22:20.102462 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-f8e5a949-4918-46d0-9abf-45aaf776de7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:22:20.103889 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-f8e5a949-4918-46d0-9abf-45aaf776de7e service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0609159
Jun 01 11:22:20.178000 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-a4d39d3f-f934-4039-ac1b-2d8bcdd4c8b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:22:20.179437 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-a4d39d3f-f934-4039-ac1b-2d8bcdd4c8b9 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0696859
Jun 01 11:22:20.316820 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-d547a5b5-b69a-4be9-bbef-6c1bf09c999b service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1307392
Jun 01 11:22:20.461932 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3eadd575-dd4f-4189-8a54-ab13796f0dcc req-3e1f30a0-8ba7-41cd-8029-33563a2781f5 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1373427
Jun 01 11:22:22.729217 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9bdd558b-ab56-464a-814c-9789cc3be5eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:24.804481 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:22:25.257183 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e55711f0-b32a-4471-8542-d354e6ea8b4a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:25.353134 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:26.436127 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:27.779843 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:46.852750 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:52.731181 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-31265c96-2dc7-414c-9950-aaa21ff191ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:55.260583 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-610e3407-846f-488d-9d11-6f295ba0ddbf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:55.354943 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:56.439051 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:22:57.783331 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:01.802746 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:23:06.176881 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a180aa-9ce3-42de-a56e-6f6c5a0c4ae9 req-0c12d361-fa27-4350-bb31-e035e4a803df tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:06.178328 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a180aa-9ce3-42de-a56e-6f6c5a0c4ae9 req-0c12d361-fa27-4350-bb31-e035e4a803df tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 945 time: 0.0796776
Jun 01 11:23:06.226480 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a180aa-9ce3-42de-a56e-6f6c5a0c4ae9 req-84a7246d-3f9e-4593-bc58-58f2aa9aa99a tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426459
Jun 01 11:23:07.420376 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ab2b97-3526-4520-a1a0-0647bf4b73b8 req-5a6f0a0e-d60f-460c-879d-7db69974a12a tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:07.421838 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a7ab2b97-3526-4520-a1a0-0647bf4b73b8 req-5a6f0a0e-d60f-460c-879d-7db69974a12a tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 945 time: 0.0809345
Jun 01 11:23:07.465419 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a7ab2b97-3526-4520-a1a0-0647bf4b73b8 req-1f8c03d2-e07d-45a6-a697-73e3e9c16e9c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0379694
Jun 01 11:23:07.630590 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41252d00-2553-4cd8-8738-2df53b28c927 req-3efddedb-adc3-4c1a-b8dd-2d104b25e419 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:07.631954 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41252d00-2553-4cd8-8738-2df53b28c927 req-3efddedb-adc3-4c1a-b8dd-2d104b25e419 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 945 time: 0.0825028
Jun 01 11:23:07.770407 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Deleting port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:23:07.776242 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:07.901999 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] For port 64b7f860-00fb-47f9-8576-ebc8396bf4e2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=64b7f860-00fb-47f9-8576-ebc8396bf4e2,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:23:07.902267 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:08.277927 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:08.278300 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:08.278605 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Floating IP 6763735a-69c2-4f00-b658-64aa60dec8e3 disassociated. External IP: 172.27.3.69, port: 64b7f860-00fb-47f9-8576-ebc8396bf4e2.
Jun 01 11:23:08.278963 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Calling delete_port for 64b7f860-00fb-47f9-8576-ebc8396bf4e2 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:23:08.388533 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:08.393935 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-7d574e94-f63e-44c8-b95a-4ce3905b1a35 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:23:08.439117 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event deleted for resources: {'Port': ['ID=64b7f860-00fb-47f9-8576-ebc8396bf4e2,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:23:08.449298 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.449685 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.450057 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.450424 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.450821 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.451127 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.451489 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.451874 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.452231 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.452581 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.452931 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.453281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:08.456978 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:23:08.653885 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f78e8d5e-9590-435c-801d-25dd4702ea60 req-702188fb-d72f-4d96-9fa1-5f6bc0f181a5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 210 time: 0.0605941
Jun 01 11:23:08.679449 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Router a59f8c59-1a3a-4919-8e53-9db5a22f8dde has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:23:08.862219 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:23:08.872229 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] Sync routers for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:23:08.884002 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:23:08.884749 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798090c70>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:22:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:23:08.936939 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] No DVR routers for this DVR port 64b7f860-00fb-47f9-8576-ebc8396bf4e2 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:23:08.939405 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:08.942004 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'name': 'network-vif-deleted', 'tag': '64b7f860-00fb-47f9-8576-ebc8396bf4e2'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:23:08.944310 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfbc882f-4c3b-4d19-b9dc-e33b4c86b191" -d '{"events": [{"server_uuid": "6edb6cbe-0e8f-42fa-9a41-cb2e8781f374", "name": "network-vif-deleted", "tag": "64b7f860-00fb-47f9-8576-ebc8396bf4e2"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:23:08.959506 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-41252d00-2553-4cd8-8738-2df53b28c927 req-cdd03a14-05fd-4f22-bc7f-36c227bfd641 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "DELETE /v2.0/ports/64b7f860-00fb-47f9-8576-ebc8396bf4e2 HTTP/1.1" status: 204  len: 173 time: 1.3215857
Jun 01 11:23:08.987291 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:23:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d105722d-bac7-40b0-a998-1242d92ad3cf x-openstack-request-id: req-d105722d-bac7-40b0-a998-1242d92ad3cf {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:23:08.987647 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6edb6cbe-0e8f-42fa-9a41-cb2e8781f374", "name": "network-vif-deleted", "tag": "64b7f860-00fb-47f9-8576-ebc8396bf4e2", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:23:08.987948 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-d105722d-bac7-40b0-a998-1242d92ad3cf {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:23:08.988386 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6edb6cbe-0e8f-42fa-9a41-cb2e8781f374', 'name': 'network-vif-deleted', 'tag': '64b7f860-00fb-47f9-8576-ebc8396bf4e2', 'status': 'completed', 'code': 200}
Jun 01 11:23:09.072524 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:23:09.384049 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798090c70>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:23:09.387806 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] Checking router: a59f8c59-1a3a-4919-8e53-9db5a22f8dde for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:23:09.396625 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:23:09.397227 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798090c70>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:22:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:23:09.625809 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:23:09.829666 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-885e2f2a-f4cb-4f35-9f98-ef727d7a996c req-9fb11646-9f0d-45a9-8f36-4153035f6c82 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Synchronizing usage tracker for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:23:09.845836 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-885e2f2a-f4cb-4f35-9f98-ef727d7a996c req-9fb11646-9f0d-45a9-8f36-4153035f6c82 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Unset dirty status for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:23:09.847245 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-885e2f2a-f4cb-4f35-9f98-ef727d7a996c req-9fb11646-9f0d-45a9-8f36-4153035f6c82 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=6edb6cbe-0e8f-42fa-9a41-cb2e8781f374 HTTP/1.1" status: 200  len: 210 time: 0.0629010
Jun 01 11:23:09.942008 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798090c70>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:23:09.946307 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1df6c02b-5fe3-4dc5-aaf6-26ee07971e8a None None] The sync data for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi is: [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:23:10.144789 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-920af08f-0c2d-449e-8434-a0d1cf4d5a00 None None] New status for floating IP 6763735a-69c2-4f00-b658-64aa60dec8e3: DOWN {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:23:10.590192 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 64b7f860-00fb-47f9-8576-ebc8396bf4e2 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:23:10.624760 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: 64b7f860-00fb-47f9-8576-ebc8396bf4e2 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:23:10.625034 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device 64b7f860-00fb-47f9-8576-ebc8396bf4e2 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:23:11.144798 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-af2d9f7e-2144-4e35-9350-a6b743b86976 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1843123992&fields=id&tenant_id=858ec485cd65427ca55a7bbfe0be5efe HTTP/1.1" status: 200  len: 267 time: 0.0452847
Jun 01 11:23:11.291389 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-5708dfd6-5d97-4927-bb24-60b5a368fe9c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:11.292807 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-5708dfd6-5d97-4927-bb24-60b5a368fe9c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 812 time: 0.1415281
Jun 01 11:23:11.307194 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-340317b7-5446-4be3-a69c-013840104945 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/quotas/858ec485cd65427ca55a7bbfe0be5efe HTTP/1.1" status: 200  len: 375 time: 0.0090911
Jun 01 11:23:11.389835 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-a35d9533-2078-42f4-9e68-f5ebe0d0d78b tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0778675
Jun 01 11:23:11.528956 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-eadae00c-2b77-412e-a0d7-e586c96077aa service neutron] 10.222.0.74 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1278670
Jun 01 11:23:11.659315 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0b9dc3b2-0451-4961-ad15-457eaa731edb service neutron] 10.222.0.74 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1248586
Jun 01 11:23:13.066306 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-21656069-179b-40b1-9961-a338548cace3 req-917f1475-da66-48e6-bb3f-f47071afcf34 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 210 time: 0.0460978
Jun 01 11:23:14.179025 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-a7b9501b-06f0-4d3d-b924-1e292cf6a05c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:14.180474 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-a7b9501b-06f0-4d3d-b924-1e292cf6a05c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 812 time: 0.2621508
Jun 01 11:23:14.235077 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-53a616fd-6d3d-4dd7-b362-4c23beff0c2c req-60cb4040-8dce-45b5-a2c0-490293770d52 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 210 time: 0.0536323
Jun 01 11:23:14.261749 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-301eef9e-869f-46c9-a57d-b7f7863eccfe tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=858ec485cd65427ca55a7bbfe0be5efe HTTP/1.1" status: 200  len: 380 time: 0.0462716
Jun 01 11:23:14.270925 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'port': {'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'admin_state_up': True, 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'security_groups': ['647a42bf-905f-496c-95f8-7c300a6ee43c']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:23:14.404298 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:23:14.414511 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:23:14.424003 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Made reservation on behalf of 858ec485cd65427ca55a7bbfe0be5efe for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:23:14.427462 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:14.593081 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Allocated IP 172.20.0.9 (8234ed64-9e09-4fc8-a5b1-b67ff870ca9e/241dacc7-1074-4a81-a1a4-074010054ea6/b527bece-ae6b-498b-93fc-d35e31fffd95) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:23:14.789843 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:14.805312 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Transition to ACTIVE for port object b527bece-ae6b-498b-93fc-d35e31fffd95 will not be triggered until provisioned by entity DHCP. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:23:14.827269 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:14.832637 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-2978da76-5db8-49f4-bdcf-6ced6c7d796f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:23:14.901314 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:23:14.904370 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:23:14.908033 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:23:14.938836 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'Port': ['ID=b527bece-ae6b-498b-93fc-d35e31fffd95,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:23:14.945779 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:23:14.977036 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:14.977651 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:15.003792 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.7363331
Jun 01 11:23:15.015836 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Request body: {'port': {'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:23:15.131614 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-bc6fc20a-44f5-43d4-8b72-ff11cc227af0 None None] Provisioning for port b527bece-ae6b-498b-93fc-d35e31fffd95 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:23:15.134249 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:15.136728 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-bc6fc20a-44f5-43d4-8b72-ff11cc227af0 None None] Provisioning complete for port b527bece-ae6b-498b-93fc-d35e31fffd95 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:23:15.137108 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-bc6fc20a-44f5-43d4-8b72-ff11cc227af0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:15.189375 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-bc6fc20a-44f5-43d4-8b72-ff11cc227af0 None None] Port b527bece-ae6b-498b-93fc-d35e31fffd95 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:23:15.476888 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93979ca7-8888-49c7-b2f9-e5853c554ae7 req-4e3e217f-697b-4ba2-8cac-ec79b16a95ea tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:15.477485 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-93979ca7-8888-49c7-b2f9-e5853c554ae7 req-4e3e217f-697b-4ba2-8cac-ec79b16a95ea tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Synchronizing usage tracker for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:23:15.542461 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-93979ca7-8888-49c7-b2f9-e5853c554ae7 req-4e3e217f-697b-4ba2-8cac-ec79b16a95ea tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Unset dirty status for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:23:15.543613 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-93979ca7-8888-49c7-b2f9-e5853c554ae7 req-4e3e217f-697b-4ba2-8cac-ec79b16a95ea tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 931 time: 0.1971929
Jun 01 11:23:15.571282 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b527bece-ae6b-498b-93fc-d35e31fffd95 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:23:15.580604 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:15.609936 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Transition to ACTIVE for port object b527bece-ae6b-498b-93fc-d35e31fffd95 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:23:15.613279 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-93979ca7-8888-49c7-b2f9-e5853c554ae7 req-dc68738a-ada1-4485-9862-de5508450620 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0631561
Jun 01 11:23:15.614331 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:15.618792 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d0fea2dc-7e16-4ded-8225-fc065b059436 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:23:15.778185 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Pushing event updated for resources: {'Port': ['ID=b527bece-ae6b-498b-93fc-d35e31fffd95,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:23:15.785495 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:23:15.853709 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Attempting to bind port b527bece-ae6b-498b-93fc-d35e31fffd95 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:23:15.854044 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Attempting to bind port b527bece-ae6b-498b-93fc-d35e31fffd95 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:23:15.854372 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Attempting to bind port b527bece-ae6b-498b-93fc-d35e31fffd95 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:23:15.858939 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Port b527bece-ae6b-498b-93fc-d35e31fffd95 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:23:15.859257 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Attempting to bind port b527bece-ae6b-498b-93fc-d35e31fffd95 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:23:15.864282 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 22, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:23:15.864614 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Checking segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:23:15.864994 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Bound using segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:23:15.865416 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Bound port: b527bece-ae6b-498b-93fc-d35e31fffd95, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:23:15.865807 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:15.956193 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] For port b527bece-ae6b-498b-93fc-d35e31fffd95, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:23:15.959098 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] For port b527bece-ae6b-498b-93fc-d35e31fffd95, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b527bece-ae6b-498b-93fc-d35e31fffd95,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:23:15.963936 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:15.968577 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-06e0b9f3-932d-490e-b211-2398efa67e77 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:23:16.113787 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:16.114458 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:16.115894 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] 10.222.0.79 "PUT /v2.0/ports/b527bece-ae6b-498b-93fc-d35e31fffd95 HTTP/1.1" status: 200  len: 1093 time: 1.1046550
Jun 01 11:23:16.116477 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:23:16.119332 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18f10472-90b7-4b92-93d6-77579cf9067c" -d '{"events": [{"name": "network-changed", "server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:23:16.150823 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Pushing event updated for resources: {'Port': ['ID=b527bece-ae6b-498b-93fc-d35e31fffd95,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:23:16.154067 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:23:16.188926 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:23:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aba7d272-c63d-4f39-ad6b-e845a010efb1 x-openstack-request-id: req-aba7d272-c63d-4f39-ad6b-e845a010efb1 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:23:16.189275 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:23:16.189569 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-aba7d272-c63d-4f39-ad6b-e845a010efb1 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:23:16.190008 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'status': 'completed', 'code': 200}
Jun 01 11:23:16.235571 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-a676fb22-ee6c-4a9f-9ec8-0aecd8c0f081 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:16.237095 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-a676fb22-ee6c-4a9f-9ec8-0aecd8c0f081 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 1096 time: 0.0803137
Jun 01 11:23:16.308930 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-c99fcc00-5410-4152-a73f-f61cb1124885 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b527bece-ae6b-498b-93fc-d35e31fffd95 HTTP/1.1" status: 200  len: 217 time: 0.0647233
Jun 01 11:23:16.374428 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-e0eac317-7557-4391-8744-cbf76e18a40d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:16.375788 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-e0eac317-7557-4391-8744-cbf76e18a40d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0613885
Jun 01 11:23:16.450239 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-237cc3c7-6bab-4329-92b7-568841de0b55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:16.451715 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-237cc3c7-6bab-4329-92b7-568841de0b55 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0700750
Jun 01 11:23:16.580752 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-0c891b9a-3869-40af-8ad6-e7e307fb22b7 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1226878
Jun 01 11:23:16.717165 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28f5d747-f160-4ed5-b7c5-380d55aa94c4 req-94aad566-8797-42ff-a728-6c4cd95f5aa9 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1285863
Jun 01 11:23:16.859346 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b3b8bba-d985-4b94-bac2-ec21a126e26c req-c220e3d3-0719-4547-82a9-4a09f6e9759b tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:16.860795 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7b3b8bba-d985-4b94-bac2-ec21a126e26c req-c220e3d3-0719-4547-82a9-4a09f6e9759b tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 943 time: 0.1367772
Jun 01 11:23:16.866312 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f10472-90b7-4b92-93d6-77579cf9067c req-ef2d336f-db4d-485d-95de-839a137531c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:16.868246 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-18f10472-90b7-4b92-93d6-77579cf9067c req-ef2d336f-db4d-485d-95de-839a137531c6 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 1096 time: 0.1023619
Jun 01 11:23:16.889950 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:16.984909 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7b3b8bba-d985-4b94-bac2-ec21a126e26c req-2fa8cae9-187a-4c89-8074-4596878cec76 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1157157
Jun 01 11:23:17.027080 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f10472-90b7-4b92-93d6-77579cf9067c req-c731d9af-6975-441b-b192-c605d2b092db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:17.028517 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-18f10472-90b7-4b92-93d6-77579cf9067c req-c731d9af-6975-441b-b192-c605d2b092db service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1443522
Jun 01 11:23:17.099578 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-18f10472-90b7-4b92-93d6-77579cf9067c req-10971b50-9b02-439a-a370-bf7dceedb926 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b527bece-ae6b-498b-93fc-d35e31fffd95 HTTP/1.1" status: 200  len: 217 time: 0.0636234
Jun 01 11:23:17.160718 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f10472-90b7-4b92-93d6-77579cf9067c req-047822f4-1125-4ec3-b54c-84dabbee398a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:17.162100 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-18f10472-90b7-4b92-93d6-77579cf9067c req-047822f4-1125-4ec3-b54c-84dabbee398a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0558257
Jun 01 11:23:17.239291 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f10472-90b7-4b92-93d6-77579cf9067c req-49c07feb-1044-4bfd-b900-4b304060b023 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:17.240683 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-18f10472-90b7-4b92-93d6-77579cf9067c req-49c07feb-1044-4bfd-b900-4b304060b023 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0714746
Jun 01 11:23:17.370615 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-18f10472-90b7-4b92-93d6-77579cf9067c req-9e50b507-e220-4a14-8ccc-c1eeba39c914 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1227229
Jun 01 11:23:17.501551 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-18f10472-90b7-4b92-93d6-77579cf9067c req-e3adba20-8f5b-4d79-bb2a-6eed644e6c83 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1244175
Jun 01 11:23:18.165878 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5fb63aa-1791-440a-a76c-2fb22a2e9c23 req-e610d9f3-4636-4763-be4c-31972504ca03 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:18.167312 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5fb63aa-1791-440a-a76c-2fb22a2e9c23 req-e610d9f3-4636-4763-be4c-31972504ca03 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 943 time: 0.0783925
Jun 01 11:23:18.210815 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d5fb63aa-1791-440a-a76c-2fb22a2e9c23 req-4511156a-9dd8-4199-83e2-2e7b8baccf14 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0371962
Jun 01 11:23:19.494847 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffc6abf7-81cf-42ff-bb26-3cf2ee637e0b req-63b5c40a-4374-4783-96a8-55f240776b51 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:19.496248 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ffc6abf7-81cf-42ff-bb26-3cf2ee637e0b req-63b5c40a-4374-4783-96a8-55f240776b51 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 943 time: 0.1811049
Jun 01 11:23:19.540467 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-ffc6abf7-81cf-42ff-bb26-3cf2ee637e0b req-27ec805a-7209-44ce-8d40-d154de4a4cf0 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385826
Jun 01 11:23:20.724318 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e26603-3f4c-49d7-800d-2231985ad719 req-4f6d2b5e-6fcc-4a8c-98fc-91d823592cab tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:20.725781 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f3e26603-3f4c-49d7-800d-2231985ad719 req-4f6d2b5e-6fcc-4a8c-98fc-91d823592cab tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 943 time: 0.0838635
Jun 01 11:23:20.772985 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f3e26603-3f4c-49d7-800d-2231985ad719 req-0e31fe30-f1c4-4e57-a140-bcad80eba7b4 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410805
Jun 01 11:23:21.961045 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1ba9fb-b7ec-4204-9d23-13300a6f6782 req-f800f0c7-7f68-41ba-b527-6065514a863c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:21.962375 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6a1ba9fb-b7ec-4204-9d23-13300a6f6782 req-f800f0c7-7f68-41ba-b527-6065514a863c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 943 time: 0.0798345
Jun 01 11:23:22.006826 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6a1ba9fb-b7ec-4204-9d23-13300a6f6782 req-46c0d71b-d336-44a7-8688-2f5583755179 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387495
Jun 01 11:23:22.733404 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-5548d93a-4681-41c5-b1dc-3296ac83709e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:23.192935 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d98077a7-06ac-46ff-a997-b7a5a0e7f504 req-7c9d3615-0d74-4647-9eb5-4fe419d817a4 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:23.194364 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d98077a7-06ac-46ff-a997-b7a5a0e7f504 req-7c9d3615-0d74-4647-9eb5-4fe419d817a4 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 943 time: 0.0821755
Jun 01 11:23:23.238699 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d98077a7-06ac-46ff-a997-b7a5a0e7f504 req-f1756035-66e8-4bd4-b076-8c20faada3c7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387545
Jun 01 11:23:24.419183 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c18d81-d87e-47c0-9a47-82ac3aaf0e6b req-76a00ecb-d995-4142-9f26-e5c183b05492 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:24.420639 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b0c18d81-d87e-47c0-9a47-82ac3aaf0e6b req-76a00ecb-d995-4142-9f26-e5c183b05492 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 943 time: 0.0800838
Jun 01 11:23:24.464249 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b0c18d81-d87e-47c0-9a47-82ac3aaf0e6b req-cef1cc99-0bc3-44b8-accc-310b7d06947e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0380864
Jun 01 11:23:24.653677 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device b527bece-ae6b-498b-93fc-d35e31fffd95 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:23:24.791124 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port b527bece-ae6b-498b-93fc-d35e31fffd95, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b527bece-ae6b-498b-93fc-d35e31fffd95,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:23:24.804009 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:23:24.858381 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:24.874591 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b527bece-ae6b-498b-93fc-d35e31fffd95 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:23:24.889945 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port b527bece-ae6b-498b-93fc-d35e31fffd95, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b527bece-ae6b-498b-93fc-d35e31fffd95,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:23:24.893952 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:24.895982 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-45c5ef12-83b3-4b35-831d-83931c05596e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:23:24.963412 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=b527bece-ae6b-498b-93fc-d35e31fffd95,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:23:24.970543 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.970889 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.971227 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.971559 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.971911 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.972236 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.972560 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.972883 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.973204 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.973522 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.973844 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.974158 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:23:24.977975 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:23:25.110074 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['b527bece-ae6b-498b-93fc-d35e31fffd95'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:23:25.281062 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-bf7886a2-803c-4cf4-b536-1ba7cb26f898 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:25.373989 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:25.650008 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6f0e4f-f882-45d2-bcc0-1b3abd3919ea req-6fe3a6c6-8dff-4b11-9c23-a4ca584cf20b tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:25.651362 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4a6f0e4f-f882-45d2-bcc0-1b3abd3919ea req-6fe3a6c6-8dff-4b11-9c23-a4ca584cf20b tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 944 time: 0.0844944
Jun 01 11:23:25.696189 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4a6f0e4f-f882-45d2-bcc0-1b3abd3919ea req-270484fd-b606-451e-a3e3-83057dd9ac27 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391326
Jun 01 11:23:26.442475 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:26.682981 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device b527bece-ae6b-498b-93fc-d35e31fffd95 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:23:26.751844 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port b527bece-ae6b-498b-93fc-d35e31fffd95 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:23:26.756524 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port b527bece-ae6b-498b-93fc-d35e31fffd95 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:23:26.756903 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:26.883955 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:26.891389 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb27f46-53c0-416f-9697-636ec0df4818 req-a9616edb-e3cd-4347-ac54-8b0c0eac6089 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:26.892895 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8fb27f46-53c0-416f-9697-636ec0df4818 req-a9616edb-e3cd-4347-ac54-8b0c0eac6089 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 944 time: 0.0892897
Jun 01 11:23:26.911459 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:23:26.913712 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3783b7c6-c1e3-4fdc-98bd-2060e9fa2002" -d '{"events": [{"server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "name": "network-vif-plugged", "status": "completed", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:23:26.921269 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port b527bece-ae6b-498b-93fc-d35e31fffd95, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b527bece-ae6b-498b-93fc-d35e31fffd95,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:23:26.925341 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:26.929092 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:23:26.938967 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8fb27f46-53c0-416f-9697-636ec0df4818 req-c4c0f72e-00ed-4983-bcfe-21c01936f965 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398078
Jun 01 11:23:26.990536 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:23:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4eaf1c38-dc82-4bf5-867c-30cea322ab16 x-openstack-request-id: req-4eaf1c38-dc82-4bf5-867c-30cea322ab16 {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:23:26.990836 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "name": "network-vif-plugged", "status": "completed", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:23:26.991096 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-4eaf1c38-dc82-4bf5-867c-30cea322ab16 {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:23:26.991489 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'code': 200}
Jun 01 11:23:27.004380 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=b527bece-ae6b-498b-93fc-d35e31fffd95,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:23:27.008931 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:23:27.265797 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82b38c5e-28fc-4c11-92a5-f133d2115b39 req-19553429-5516-48d0-a767-ad7d4b58f92e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:27.267219 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-82b38c5e-28fc-4c11-92a5-f133d2115b39 req-19553429-5516-48d0-a767-ad7d4b58f92e service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 1098 time: 0.0727944
Jun 01 11:23:27.308402 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-82b38c5e-28fc-4c11-92a5-f133d2115b39 req-f3e4d778-5d44-4e2b-99a8-25a05bd65e5b service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0348656
Jun 01 11:23:27.786994 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:28.125491 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6ca1b1b-eb8a-43d8-895b-39a41a738391 req-8c18644d-070b-4a3f-97eb-f89b660e4238 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:28.127012 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b6ca1b1b-eb8a-43d8-895b-39a41a738391 req-8c18644d-070b-4a3f-97eb-f89b660e4238 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 945 time: 0.0786815
Jun 01 11:23:28.175802 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b6ca1b1b-eb8a-43d8-895b-39a41a738391 req-c98d6787-46b7-492a-bda9-626869898412 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0431812
Jun 01 11:23:29.358274 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32140d10-5e97-4ee3-ae09-db51f581725e req-87665279-f87e-475d-b397-dcb23c6cdee4 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:29.359748 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-32140d10-5e97-4ee3-ae09-db51f581725e req-87665279-f87e-475d-b397-dcb23c6cdee4 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 945 time: 0.0808101
Jun 01 11:23:29.405906 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-32140d10-5e97-4ee3-ae09-db51f581725e req-2060fe55-d40d-441a-919c-66d6520f6227 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404141
Jun 01 11:23:29.592555 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c57b50-e5a4-4984-ae6c-f5bcb9e77516 req-e4d7ece3-ba29-412a-bd8a-03c33239dd20 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:29.593915 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a8c57b50-e5a4-4984-ae6c-f5bcb9e77516 req-e4d7ece3-ba29-412a-bd8a-03c33239dd20 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 945 time: 0.0827878
Jun 01 11:23:29.638186 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a8c57b50-e5a4-4984-ae6c-f5bcb9e77516 req-4ff24edd-e29f-42cf-b069-66b390386fa8 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386970
Jun 01 11:23:29.661481 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40316) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:23:29.731751 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a48d9ee2-c4a9-4fb6-8a1a-8216628eff17 tempest-TestVolumeBootPattern-49478070 tempest-TestVolumeBootPattern-49478070-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:29.733244 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-a48d9ee2-c4a9-4fb6-8a1a-8216628eff17 tempest-TestVolumeBootPattern-49478070 tempest-TestVolumeBootPattern-49478070-project-admin] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 1093 time: 0.0708151
Jun 01 11:23:29.736124 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40320) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:23:29.741303 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'floatingip': {'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address': '172.20.0.9'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:23:29.747122 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:23:29.750960 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:floatingip and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:23:29.753832 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=119241) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:23:29.760050 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:23:29.770284 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:29.906589 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:30.039257 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Allocated IP 172.27.3.21 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/16b2b6fe-14da-49be-8270-801b816ed1d8) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:23:30.185630 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:30.213096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:30.217439 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-6b62b8e3-ad4c-4fdb-ba85-1bc03c4d242e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:23:30.278128 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:23:30.280941 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:23:30.284541 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:23:30.321534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'Port': ['ID=16b2b6fe-14da-49be-8270-801b816ed1d8,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:23:30.325507 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:23:30.780908 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:30.853320 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:31.053960 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:31.058768 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:31.063084 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-54d92b14-dc32-4238-a3cb-4bde2f28715e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:23:31.166879 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'Port': ['ID=16b2b6fe-14da-49be-8270-801b816ed1d8,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:23:31.170745 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:23:31.177158 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:31.344179 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Floating IP 3b151f89-e762-4dda-b167-b739caf54bf7 associated. External IP: 172.27.3.21, port: b527bece-ae6b-498b-93fc-d35e31fffd95.
Jun 01 11:23:31.686416 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Router a59f8c59-1a3a-4919-8e53-9db5a22f8dde has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:23:31.971378 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:23:31.980351 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] Sync routers for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:23:31.990288 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:23:31.990905 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57987afbb0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:23:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:23:31.995978 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:32.051025 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 2.3138762
Jun 01 11:23:32.051704 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:23:32.053963 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d076272d-0e6e-4feb-92ad-29d52ac050f3" -d '{"events": [{"name": "network-changed", "server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:23:32.095900 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:23:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e16a7dd7-ae1b-41b1-9ae8-3f26325b11ec x-openstack-request-id: req-e16a7dd7-ae1b-41b1-9ae8-3f26325b11ec {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:23:32.096234 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:23:32.096524 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-e16a7dd7-ae1b-41b1-9ae8-3f26325b11ec {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:23:32.096952 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'status': 'completed', 'code': 200}
Jun 01 11:23:32.170329 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:23:32.189311 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-3265d1ca-746d-4a22-872c-643e0a969042 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:32.190776 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-3265d1ca-746d-4a22-872c-643e0a969042 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 1098 time: 0.0721977
Jun 01 11:23:32.321625 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-3ab2ede8-5ed5-48d5-ae12-e14a1cf846ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:32.322959 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-3ab2ede8-5ed5-48d5-ae12-e14a1cf846ed service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1253216
Jun 01 11:23:32.428659 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-868d65c4-ef39-405c-beef-98a9b0861d3c service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b527bece-ae6b-498b-93fc-d35e31fffd95 HTTP/1.1" status: 200  len: 998 time: 0.0979049
Jun 01 11:23:32.490621 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-974093be-cad2-4e29-b921-c15160230711 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:32.492087 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-974093be-cad2-4e29-b921-c15160230711 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0568230
Jun 01 11:23:32.556544 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57987afbb0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '3b151f89-e762-4dda-b167-b739caf54bf7', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.21', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:23:30Z', 'updated_at': '2021-06-01T11:23:30Z', 'revision_number': 0, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:23:32.560487 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] Checking router: a59f8c59-1a3a-4919-8e53-9db5a22f8dde for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:23:32.566362 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-a568dc6a-98d6-4592-8756-8c6c09b03031 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:23:32.567890 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-a568dc6a-98d6-4592-8756-8c6c09b03031 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0695293
Jun 01 11:23:32.569031 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:23:32.569640 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57987afbb0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:23:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:23:32.704521 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-ac9c846e-d280-4c3d-b511-39710163bf72 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1295290
Jun 01 11:23:32.749473 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:23:32.837258 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d076272d-0e6e-4feb-92ad-29d52ac050f3 req-e1fb9408-e2fa-4740-9870-7667d3865913 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1266592
Jun 01 11:23:33.093160 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57987afbb0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '3b151f89-e762-4dda-b167-b739caf54bf7', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.21', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:23:30Z', 'updated_at': '2021-06-01T11:23:30Z', 'revision_number': 0, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:23:33.097014 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60d5ea62-6fac-4320-9eba-3e9cb87c2316 None None] The sync data for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi is: [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '3b151f89-e762-4dda-b167-b739caf54bf7', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.21', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:23:30Z', 'updated_at': '2021-06-01T11:23:30Z', 'revision_number': 0, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:23:33.261947 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-393b64ba-3dd3-4595-915c-577681d4bd03 None None] New status for floating IP 3b151f89-e762-4dda-b167-b739caf54bf7: ACTIVE {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:23:38.801527 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:23:46.885225 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:52.734968 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-95fd43ba-104d-4ea3-af2d-e438dfa51571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:55.262832 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-37a86535-3c7e-4da7-95fd-e195f8a64e81 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:55.355038 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:56.445475 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:23:57.788946 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:15.799521 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:24:16.902791 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:22.729939 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-ff32e28e-66da-4b1b-b84f-983b67978019 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1466825
Jun 01 11:24:22.736931 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e04b2169-e280-4b74-88db-7c5b2c5c8dfa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:22.867409 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-cb649f8d-184d-4164-9720-c0be8bce3213 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:24:22.868792 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-cb649f8d-184d-4164-9720-c0be8bce3213 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 1098 time: 0.0708740
Jun 01 11:24:23.024878 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-420df5e9-1858-411f-a3c0-6744058a0b2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:24:23.026537 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-420df5e9-1858-411f-a3c0-6744058a0b2a service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1391017
Jun 01 11:24:23.129588 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-b087a55c-2314-4d61-bc69-984befcc8087 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b527bece-ae6b-498b-93fc-d35e31fffd95 HTTP/1.1" status: 200  len: 1000 time: 0.0962725
Jun 01 11:24:23.197000 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-766f1ee5-eafd-4cce-a4b5-42a20a0a2a08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:24:23.198496 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-766f1ee5-eafd-4cce-a4b5-42a20a0a2a08 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0627677
Jun 01 11:24:23.275484 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-207a798f-9003-4dff-9d7b-c1b72efff408 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:24:23.276996 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-207a798f-9003-4dff-9d7b-c1b72efff408 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0720856
Jun 01 11:24:23.407166 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-b4856023-51d5-4ee7-bfd5-2b24e1ae3c4b service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1239142
Jun 01 11:24:23.642516 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-96910176-2b75-4f02-8e5d-5ecf6b142f76 req-0d1727e2-6bad-499c-b52f-92429f40e0d4 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2289882
Jun 01 11:24:25.265233 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9f6ba7fd-5945-45e9-94a9-ded6b8ecda3a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:25.355781 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:26.448746 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:27.792701 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:34.010161 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [req-149fdd7b-d44b-41a5-aca2-e5ae4074bdb6 req-a3e42183-5b75-4484-90d9-5814e602fea1 service neutron] (119241) timed out ('10.222.0.79', 58747) {{(pid=119241) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 11:24:46.914334 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:52.738423 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-11168b5c-7924-417d-8e58-56e8fda69001 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:52.797963 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:24:55.266900 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-15aecc48-d401-449c-93a5-02acabc1871c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:55.357533 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:56.450856 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:24:57.795924 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:08.095007 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-9a2d5613-1838-42b0-bdf0-11659c6bac48 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1843123992&fields=id&tenant_id=858ec485cd65427ca55a7bbfe0be5efe HTTP/1.1" status: 200  len: 267 time: 0.0400772
Jun 01 11:25:08.243104 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-07915e87-328a-4de8-b788-ac1255de689e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:08.244568 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-07915e87-328a-4de8-b788-ac1255de689e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 812 time: 0.1434035
Jun 01 11:25:08.258916 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-3d6125e9-5bf4-4574-ac0e-aeb4a9c1bbe4 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/quotas/858ec485cd65427ca55a7bbfe0be5efe HTTP/1.1" status: 200  len: 375 time: 0.0090437
Jun 01 11:25:08.350041 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-904805c4-3f28-4b9a-847a-8806cf0b7d51 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0856912
Jun 01 11:25:08.483251 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-6528a18a-a7b1-43c6-9674-255c7bf83204 service neutron] 10.222.0.74 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1221731
Jun 01 11:25:08.610098 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-754185ef-ad43-4e07-a542-206c9822e5f8 service neutron] 10.222.0.74 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1210089
Jun 01 11:25:08.986849 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-34031492-5ff3-45af-be0c-8e7073536c8d req-747ac553-a9c5-40f3-b7c8-58d4fd53d264 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 210 time: 0.0419774
Jun 01 11:25:09.987880 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-ca70fd64-8895-4dd3-a737-5a1809997c05 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:09.989304 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-ca70fd64-8895-4dd3-a737-5a1809997c05 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 812 time: 0.1504474
Jun 01 11:25:10.039297 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-7f7436ed-3b89-4113-ad40-a4273314bcfa tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=858ec485cd65427ca55a7bbfe0be5efe HTTP/1.1" status: 200  len: 380 time: 0.0417597
Jun 01 11:25:10.049103 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'port': {'device_id': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'admin_state_up': True, 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'security_groups': ['647a42bf-905f-496c-95f8-7c300a6ee43c']}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:25:10.182553 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-d34e38ae-5d52-47a1-8725-18c73a87c5d9 req-b9121b94-0b0e-4fd7-a0fb-e4de59cad3cd tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 210 time: 0.0588379
Jun 01 11:25:10.231080 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:25:10.240818 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.quota.driver [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=119241) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:25:10.249867 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Made reservation on behalf of 858ec485cd65427ca55a7bbfe0be5efe for: {'port': 1} {{(pid=119241) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 11:25:10.253351 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:10.422546 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.db_base_plugin_common [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Allocated IP 172.20.0.5 (8234ed64-9e09-4fc8-a5b1-b67ff870ca9e/241dacc7-1074-4a81-a1a4-074010054ea6/ecf21f5b-9805-4bf8-be60-e848dd9fb8c9) {{(pid=119241) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:25:10.613229 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for port, precommit_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:10.630058 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Transition to ACTIVE for port object ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 will not be triggered until provisioned by entity DHCP. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:25:10.653823 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_create {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:10.659402 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-d691b3a4-c873-46d4-8664-ef66d1cf6e5c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:25:10.728736 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e is already hosted by enough agents. {{(pid=119241) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:25:10.733030 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.base_scheduler [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources bound (agent type, host, resource id):  {{(pid=119241) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:25:10.737200 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Received port after_create {{(pid=119241) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:25:10.778493 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'Port': ['ID=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,revision_number=1']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:25:10.796180 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.796554 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.796918 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.797275 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.797627 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.797981 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.798334 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.798684 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.799036 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.799381 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.799753 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.800097 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:10.805429 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:25:10.821019 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:10.821625 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:10.847223 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8018701
Jun 01 11:25:10.860849 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.v2.base [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Request body: {'port': {'device_id': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=119241) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:25:10.934786 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-364208a1-8577-467d-9c6a-bb5221cdd6f6 None None] Provisioning for port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 completed by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:25:10.939526 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-364208a1-8577-467d-9c6a-bb5221cdd6f6 None None] Provisioning complete for port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 triggered by entity DHCP. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:25:10.939946 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-364208a1-8577-467d-9c6a-bb5221cdd6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:10.997171 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-364208a1-8577-467d-9c6a-bb5221cdd6f6 None None] Port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 cannot update to ACTIVE because it is not bound. {{(pid=119242) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 11:25:11.088786 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:11.431867 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a6f353a-c322-4de1-85e1-34654cdad15d req-6ba37d87-a507-4bea-ab05-125d85b6dd57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:11.432561 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1a6f353a-c322-4de1-85e1-34654cdad15d req-6ba37d87-a507-4bea-ab05-125d85b6dd57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Synchronizing usage tracker for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:25:11.505626 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-1a6f353a-c322-4de1-85e1-34654cdad15d req-6ba37d87-a507-4bea-ab05-125d85b6dd57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Unset dirty status for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:25:11.506779 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a6f353a-c322-4de1-85e1-34654cdad15d req-6ba37d87-a507-4bea-ab05-125d85b6dd57 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 931 time: 0.2085254
Jun 01 11:25:11.512769 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 {{(pid=119241) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:25:11.534761 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Notify callbacks [] for port, precommit_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:11.560958 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.provisioning_blocks [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Transition to ACTIVE for port object ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 will not be triggered until provisioned by entity L2. {{(pid=119241) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 11:25:11.565115 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:11.571212 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c69b3778-48c2-48f1-a10e-239bd430a1d9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:25:11.611107 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-1a6f353a-c322-4de1-85e1-34654cdad15d req-10216c24-f7ee-4500-a0cb-9cba8a6f8102 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0940523
Jun 01 11:25:11.723958 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Pushing event updated for resources: {'Port': ['ID=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,revision_number=2']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:25:11.731948 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:25:11.806601 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Attempting to bind port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 on host hv-cinder-78776 for vnic_type normal with profile  {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 11:25:11.806929 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Attempting to bind port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 11:25:11.807246 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Attempting to bind port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:25:11.812433 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 11:25:11.812744 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Attempting to bind port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 on network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 11:25:11.817710 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Checking agent: {'id': '31b0b089-14db-4571-a72d-d2799e729c11', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'started_at': datetime.datetime(2021, 6, 1, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 11, 24, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 11:25:11.818039 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Checking segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=119241) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 11:25:11.818416 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Bound using segment: {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'} {{(pid=119241) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 11:25:11.818831 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.managers [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Bound port: ecf21f5b-9805-4bf8-be60-e848dd9fb8c9, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4caee24c-4c25-4ae5-bbe3-00c9bec6902a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 689, 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e'}}] {{(pid=119241) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 11:25:11.819169 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:11.905104 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] For port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9, host hv-cinder-78776, cleared binding levels {{(pid=119241) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 11:25:11.908212 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] For port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119241) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 11:25:11.912567 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10959854'] for port, after_update {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:11.917048 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-65fcdc50-248a-4f0c-ae10-172fbb8aca4f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:25:11.974534 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:11.975150 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:11.976556 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] 10.222.0.79 "PUT /v2.0/ports/ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 HTTP/1.1" status: 200  len: 1093 time: 1.1207764
Jun 01 11:25:11.977073 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:25:11.979729 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a619d5d-f0b0-47c6-9b23-9084937eb662" -d '{"events": [{"name": "network-changed", "server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:25:12.001096 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Pushing event updated for resources: {'Port': ['ID=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,revision_number=3']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:25:12.004202 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-4a76714f-620b-4cd4-9981-81848fe6c806 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:25:12.095064 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-012ee198-e642-43db-b65e-efb6b9f8b86b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:12.097708 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-012ee198-e642-43db-b65e-efb6b9f8b86b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 1096 time: 0.0800970
Jun 01 11:25:12.100303 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:25:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f3917ba-71c0-4546-885f-1ca646f25369 x-openstack-request-id: req-8f3917ba-71c0-4546-885f-1ca646f25369 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:25:12.100779 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:25:12.101081 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-8f3917ba-71c0-4546-885f-1ca646f25369 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:25:12.101551 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'status': 'completed', 'code': 200}
Jun 01 11:25:12.178256 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-d7f591ce-085a-491c-89b3-12ba2ba150cc service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 HTTP/1.1" status: 200  len: 217 time: 0.0667667
Jun 01 11:25:12.240896 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-a1c1d07a-e605-4851-a723-640cb173ee0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:12.242329 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-a1c1d07a-e605-4851-a723-640cb173ee0d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0571918
Jun 01 11:25:12.320205 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-41f84065-6937-43a5-92ce-7abe42e6d3ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:12.321650 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-41f84065-6937-43a5-92ce-7abe42e6d3ad service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0727875
Jun 01 11:25:12.451708 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-c169f756-6ce3-4582-87e6-abc65926f8fa service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1231425
Jun 01 11:25:12.580993 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a52a9605-5e1b-4c16-8e5e-021009b63f99 req-b1d22e33-7c4a-4815-bd85-b2ec3fe8ffda service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1231081
Jun 01 11:25:12.694835 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-ccf0f28a-ce9f-4146-a12e-b61f032a2c66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:12.699395 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-ccf0f28a-ce9f-4146-a12e-b61f032a2c66 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 1096 time: 0.0704169
Jun 01 11:25:12.981282 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-4d45fcd3-7466-42e4-ad59-36430d63ad4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:12.982723 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-4d45fcd3-7466-42e4-ad59-36430d63ad4a service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.2793310
Jun 01 11:25:12.994116 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1f93b98-3a4d-4bf5-9165-abfd407ebbfd req-22226f51-011f-4767-94a9-d45556a870d8 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:12.995458 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c1f93b98-3a4d-4bf5-9165-abfd407ebbfd req-22226f51-011f-4767-94a9-d45556a870d8 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 943 time: 0.2719245
Jun 01 11:25:13.074830 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-c091057d-7e6b-447f-b794-23f48ef7d538 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 HTTP/1.1" status: 200  len: 217 time: 0.0779130
Jun 01 11:25:13.139183 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c1f93b98-3a4d-4bf5-9165-abfd407ebbfd req-074adae5-ce4e-4885-8ba3-eedc88905083 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0912485
Jun 01 11:25:13.157395 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-aad35ed4-88ba-427a-9ce3-c62205cddb29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:13.158822 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-aad35ed4-88ba-427a-9ce3-c62205cddb29 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0769536
Jun 01 11:25:13.234292 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-bb3cead3-dddf-459a-926f-a423d6c935cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:13.235516 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-bb3cead3-dddf-459a-926f-a423d6c935cf service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0692160
Jun 01 11:25:13.365203 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-d8c8a986-9d09-4a74-8176-d0cb9be07a9a service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1233141
Jun 01 11:25:13.496913 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-9a619d5d-f0b0-47c6-9b23-9084937eb662 req-bedf0f13-658b-4a5b-b1be-6159edfbb4d2 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252124
Jun 01 11:25:14.324045 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c7f23ea-05c8-4687-909b-1b172a97cd32 req-92461565-15f2-4928-8985-6d40125dc7d3 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:14.326014 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5c7f23ea-05c8-4687-909b-1b172a97cd32 req-92461565-15f2-4928-8985-6d40125dc7d3 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 943 time: 0.0850582
Jun 01 11:25:14.369294 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-5c7f23ea-05c8-4687-909b-1b172a97cd32 req-82ad2a3f-dea8-438f-a73d-dd080143ff91 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377789
Jun 01 11:25:15.553128 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6994fb0b-8d25-4792-9ba2-57b927286d08 req-5fb90e1b-e1ea-472c-a8cc-20204fac15d5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:15.554574 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6994fb0b-8d25-4792-9ba2-57b927286d08 req-5fb90e1b-e1ea-472c-a8cc-20204fac15d5 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 943 time: 0.0806770
Jun 01 11:25:15.598385 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-6994fb0b-8d25-4792-9ba2-57b927286d08 req-3049fd20-f102-4e8d-b428-2a8138be2d8c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377889
Jun 01 11:25:16.782682 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a291d04-33f6-42c9-b1ee-8c7eb37588f1 req-062c4bf1-e82f-4334-a90b-212c41237c12 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:16.784156 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2a291d04-33f6-42c9-b1ee-8c7eb37588f1 req-062c4bf1-e82f-4334-a90b-212c41237c12 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 943 time: 0.0836649
Jun 01 11:25:16.827934 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-2a291d04-33f6-42c9-b1ee-8c7eb37588f1 req-96f86f51-b4d4-4623-acde-37561c6c95a1 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382512
Jun 01 11:25:16.930059 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:18.011736 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05a9ee4a-dc40-4f40-acc1-1c6fe6959328 req-14755912-b701-4f35-814a-8c6d761b3e1b tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:18.015847 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-05a9ee4a-dc40-4f40-acc1-1c6fe6959328 req-14755912-b701-4f35-814a-8c6d761b3e1b tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 943 time: 0.0856137
Jun 01 11:25:18.063828 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-05a9ee4a-dc40-4f40-acc1-1c6fe6959328 req-567ca7c4-9910-4ca7-8b61-e9153d54103f tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0450079
Jun 01 11:25:19.119544 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=119242) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 11:25:19.250273 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6635eab-2ff1-4d12-9fb5-ffa8eac9d555 req-96d0a462-a5c7-4d1d-831f-773187e86514 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:19.251957 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b6635eab-2ff1-4d12-9fb5-ffa8eac9d555 req-96d0a462-a5c7-4d1d-831f-773187e86514 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 943 time: 0.0821981
Jun 01 11:25:19.298406 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:25:19.298683 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-b6635eab-2ff1-4d12-9fb5-ffa8eac9d555 req-80ea67e0-6fde-4c8e-83ec-f445311bd522 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387955
Jun 01 11:25:19.312405 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Returning: {'device': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'port_id': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'mac_address': 'fa:16:3e:e9:a2:ca', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=119242) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 11:25:19.366838 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:19.383340 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 {{(pid=119242) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 11:25:19.398951 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:25:19.403155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:19.404849 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:25:19.471343 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,revision_number=4']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:25:19.478545 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.478892 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.479237 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.479570 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.479923 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.480256 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.480581 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.480907 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.481238 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.482088 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.482410 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.482730 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:19.486528 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:25:19.617647 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] get_ports_and_sgs() called for port_ids ['ecf21f5b-9805-4bf8-be60-e848dd9fb8c9'] {{(pid=119242) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 11:25:20.483754 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c114bfb9-a8d3-4673-b768-b9aad4f1f62e req-3f1ff323-4cfe-4638-91a3-e169f82bb3e4 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:20.485206 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c114bfb9-a8d3-4673-b768-b9aad4f1f62e req-3f1ff323-4cfe-4638-91a3-e169f82bb3e4 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 944 time: 0.0835834
Jun 01 11:25:20.529756 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-c114bfb9-a8d3-4673-b768-b9aad4f1f62e req-36cef60f-4b28-4b58-8df3-b258dea41d4c tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390320
Jun 01 11:25:21.118930 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 up at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 11:25:21.189597 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning for port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 completed by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 11:25:21.194009 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.provisioning_blocks [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Provisioning complete for port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 triggered by entity L2. {{(pid=119242) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 11:25:21.194378 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4130859'] for port, provisioning_complete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:21.304128 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:21.330090 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9'}] {{(pid=119242) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:25:21.332411 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}da9011e237885c72c51366509ae3656749ab1075449e5fe530bc5f8b1b5bb61e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6bb10fb2-3124-4292-bd72-f6f04629bc50" -d '{"events": [{"server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "name": "network-vif-plugged", "status": "completed", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9"}]}' {{(pid=119242) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:25:21.340325 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] For port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:25:21.345028 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990'] for port, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:21.346714 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-03cc22c7-baee-4cf5-b61c-ba9bd92f1dea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:25:21.383981 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:25:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47b4f06e-26b8-4649-a4d7-5ad7522a402b x-openstack-request-id: req-47b4f06e-26b8-4649-a4d7-5ad7522a402b {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:25:21.384285 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "name": "network-vif-plugged", "status": "completed", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9", "code": 200}]} {{(pid=119242) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:25:21.384548 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-47b4f06e-26b8-4649-a4d7-5ad7522a402b {{(pid=119242) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:25:21.384935 dv-cinder-787764-3-iscsi neutron-server[119242]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'code': 200}
Jun 01 11:25:21.417040 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Pushing event updated for resources: {'Port': ['ID=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,revision_number=5']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:25:21.420475 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:25:21.698094 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ac8782-38ba-4dce-854d-d0bd3b724cb3 req-d7a65531-d352-4384-8654-da1f2d578e52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:21.699557 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-92ac8782-38ba-4dce-854d-d0bd3b724cb3 req-d7a65531-d352-4384-8654-da1f2d578e52 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 1098 time: 0.1213577
Jun 01 11:25:21.753281 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14783e06-fb38-446a-b865-e961780714ab req-0553525d-57dc-4d67-a4e5-e511052e0afd tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:21.754661 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-14783e06-fb38-446a-b865-e961780714ab req-0553525d-57dc-4d67-a4e5-e511052e0afd tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 945 time: 0.1195018
Jun 01 11:25:21.757891 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-92ac8782-38ba-4dce-854d-d0bd3b724cb3 req-59612b80-4e05-4e45-9e61-82fdfbb28e37 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0503850
Jun 01 11:25:21.799309 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-14783e06-fb38-446a-b865-e961780714ab req-6ac813cf-4284-4ce6-8cee-4045f1b5fc86 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390775
Jun 01 11:25:22.654771 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-8c32382c-b792-4fac-9c06-83794e94d105 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0718977
Jun 01 11:25:22.740521 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-00a350e1-a770-418c-bbff-8c25f8ad4907 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:22.794603 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-df4b14b5-7a9e-42ba-938f-22c617facda0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:22.796182 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-df4b14b5-7a9e-42ba-938f-22c617facda0 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 1098 time: 0.0717332
Jun 01 11:25:23.090416 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-dcdd413f-52dd-464f-926d-07f6526a8d77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:23.092308 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-dcdd413f-52dd-464f-926d-07f6526a8d77 service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.2763209
Jun 01 11:25:23.159494 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f40991-9e27-4331-b1b2-5e56aa6e348a req-6d675fc0-ffab-4fa7-9282-741b8bcb615a tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:23.160946 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a2f40991-9e27-4331-b1b2-5e56aa6e348a req-6d675fc0-ffab-4fa7-9282-741b8bcb615a tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 945 time: 0.1820028
Jun 01 11:25:23.235414 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-01647a44-9239-43ec-a5ff-8cf920d6be8e service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b527bece-ae6b-498b-93fc-d35e31fffd95 HTTP/1.1" status: 200  len: 1000 time: 0.1363227
Jun 01 11:25:23.238280 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a2f40991-9e27-4331-b1b2-5e56aa6e348a req-3c1db49d-3578-478a-b2fd-0a3b8c4cd860 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0695791
Jun 01 11:25:23.301846 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-f4a802ab-779a-4403-badd-35aa608c7e7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:23.303281 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-f4a802ab-779a-4403-badd-35aa608c7e7a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0596783
Jun 01 11:25:23.438588 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-3baadbe8-554f-4467-b68a-10db2eec1e63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:23.440069 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-3baadbe8-554f-4467-b68a-10db2eec1e63 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1302240
Jun 01 11:25:23.455323 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a586a79d-f80b-4321-98c5-c6c66f8bbaf8 req-13cc021e-3787-4f3d-80fb-efd4adfa5ccf tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:23.456734 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a586a79d-f80b-4321-98c5-c6c66f8bbaf8 req-13cc021e-3787-4f3d-80fb-efd4adfa5ccf tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 945 time: 0.1041083
Jun 01 11:25:23.581250 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-a586a79d-f80b-4321-98c5-c6c66f8bbaf8 req-5134dcc0-7e4d-4aa3-92a0-989de146b067 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1067514
Jun 01 11:25:23.605082 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40446) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:25:23.617490 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-e346a60c-f500-4673-aa5c-f62759ec69cf service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1704302
Jun 01 11:25:23.681316 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a02489d5-5506-4733-925d-712d8c13af8c tempest-TestVolumeBootPattern-49478070 tempest-TestVolumeBootPattern-49478070-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119240) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:23.682029 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a02489d5-5506-4733-925d-712d8c13af8c tempest-TestVolumeBootPattern-49478070 tempest-TestVolumeBootPattern-49478070-project-admin] Synchronizing usage tracker for tenant:b0898f5cd58046c4a3a5343c0ec03baf on resource:port {{(pid=119240) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:25:23.703559 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-a02489d5-5506-4733-925d-712d8c13af8c tempest-TestVolumeBootPattern-49478070 tempest-TestVolumeBootPattern-49478070-project-admin] Unset dirty status for tenant:b0898f5cd58046c4a3a5343c0ec03baf on resource:port {{(pid=119240) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:25:23.705363 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-a02489d5-5506-4733-925d-712d8c13af8c tempest-TestVolumeBootPattern-49478070 tempest-TestVolumeBootPattern-49478070-project-admin] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 1093 time: 0.0991664
Jun 01 11:25:23.708146 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40450) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:25:23.715019 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.v2.base [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Request body: {'floatingip': {'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'port_id': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address': '172.20.0.5'}} {{(pid=119240) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 11:25:23.721031 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 11:25:23.724907 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Usage tracker for resource:floatingip and tenant:858ec485cd65427ca55a7bbfe0be5efe is out of sync, need to count used quota {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 11:25:23.727779 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.quota.resource [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=119240) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 11:25:23.734953 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.quota.driver [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=119240) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 11:25:23.750132 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:23.759095 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-f5a797ea-e2b4-4de5-9891-aca2174150e9 req-9df7a5f1-551c-49e5-be03-7169f5f24bfb service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1343238
Jun 01 11:25:23.885172 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:24.024329 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_common [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Allocated IP 172.27.3.71 (75238de6-1437-4113-aa89-3deeb50d4603/3393ce80-c770-4ca6-8844-f1f0c4351344/2fa56013-da3f-4fbc-b671-83c5a817ac28) {{(pid=119240) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 11:25:24.168234 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for port, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:24.197975 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750888211667', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:24.202100 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-86b9f83c-a8ad-466f-b959-ebfcc16af47b tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:25:24.266603 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Network 75238de6-1437-4113-aa89-3deeb50d4603 is already hosted by enough agents. {{(pid=119240) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 11:25:24.269406 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.base_scheduler [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Resources bound (agent type, host, resource id):  {{(pid=119240) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 11:25:24.275292 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Received port after_create {{(pid=119240) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 11:25:24.307845 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'Port': ['ID=2fa56013-da3f-4fbc-b671-83c5a817ac28,revision_number=1']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:25:24.323271 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.323666 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.324036 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.324400 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.324759 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.325629 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.326053 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.326414 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.326768 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.327298 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.327634 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.327984 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:25:24.332808 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:25:24.692004 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, precommit_create {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:24.765488 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-4112413'] for port, before_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:25.059332 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for port, precommit_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:25.065441 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750888646292', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750888211685', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750888211990', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10646127'] for port, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:25.069845 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-cdb6beea-784e-40ca-871e-bffb7113497d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:25:25.176232 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event updated for resources: {'Port': ['ID=2fa56013-da3f-4fbc-b671-83c5a817ac28,revision_number=2']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:25:25.180158 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:25:25.186513 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-645278'] for floatingip, after_update {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:25.268648 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-f9ed1e8b-b01a-4d16-9d88-4a90e712a81a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:25.360441 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:25.361761 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.l3_db [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Floating IP c1bf70ff-3c83-423d-8e52-7daf61bf7889 associated. External IP: 172.27.3.71, port: ecf21f5b-9805-4bf8-be60-e848dd9fb8c9.
Jun 01 11:25:25.711893 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Router a59f8c59-1a3a-4919-8e53-9db5a22f8dde has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:25:25.897717 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:25:25.908485 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] Sync routers for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:25:25.917868 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:25:25.918492 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579880c7c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:25:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:25:25.923604 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:25.977725 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-8b0178d1-49d9-467c-89a1-fa724bb62aef tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 2.2684617
Jun 01 11:25:25.978304 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:25:25.980606 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31" -d '{"events": [{"name": "network-changed", "server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:25:26.076921 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:25:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c5c9f31-a962-40ee-8ddd-d40436b35478 x-openstack-request-id: req-3c5c9f31-a962-40ee-8ddd-d40436b35478 {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:25:26.077261 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:25:26.077563 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-3c5c9f31-a962-40ee-8ddd-d40436b35478 {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:25:26.078005 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'status': 'completed', 'code': 200}
Jun 01 11:25:26.110199 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:25:26.178319 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-db5db295-b661-4eb6-b95d-082a00533e03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:26.179929 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-db5db295-b661-4eb6-b95d-082a00533e03 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 1098 time: 0.0799527
Jun 01 11:25:26.310519 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-00393334-4167-40a2-a784-7f74dd4b68bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:26.311908 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-00393334-4167-40a2-a784-7f74dd4b68bc service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1261504
Jun 01 11:25:26.414742 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-2aac8dad-4666-4ec5-9f33-2e0f3d0f4e4d service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 HTTP/1.1" status: 200  len: 998 time: 0.0968783
Jun 01 11:25:26.461696 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:26.476570 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579880c7c0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '3b151f89-e762-4dda-b167-b739caf54bf7', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.21', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:23:30Z', 'updated_at': '2021-06-01T11:23:33Z', 'revision_number': 1, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}, {'id': 'c1bf70ff-3c83-423d-8e52-7daf61bf7889', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.71', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:e9:a2:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:25:24Z', 'updated_at': '2021-06-01T11:25:24Z', 'revision_number': 0, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:25:26.480561 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] Checking router: a59f8c59-1a3a-4919-8e53-9db5a22f8dde for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:25:26.483953 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-b0008c6c-4895-4f6c-979b-0b33e9dd2855 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:26.485424 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-b0008c6c-4895-4f6c-979b-0b33e9dd2855 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0645704
Jun 01 11:25:26.489570 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:25:26.490174 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579880c7c0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:25:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:25:26.562317 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-2c157689-b050-49ea-9f54-0ecdbed633ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:25:26.563754 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-2c157689-b050-49ea-9f54-0ecdbed633ef service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0723546
Jun 01 11:25:26.670803 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:25:26.696039 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-821d8527-31ec-4379-ad8c-8bd969c4381e service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1255298
Jun 01 11:25:26.831915 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-7c2dca48-c9ff-4cc0-a345-bb7613c9ad31 req-ccb2acf0-6190-4ee5-92d0-3391f71135ff service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1298404
Jun 01 11:25:27.058474 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579880c7c0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '3b151f89-e762-4dda-b167-b739caf54bf7', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.21', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:23:30Z', 'updated_at': '2021-06-01T11:23:33Z', 'revision_number': 1, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}, {'id': 'c1bf70ff-3c83-423d-8e52-7daf61bf7889', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.71', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:e9:a2:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:25:24Z', 'updated_at': '2021-06-01T11:25:24Z', 'revision_number': 0, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:25:27.064073 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18b95f31-ca05-4fed-9dd4-6a86b1a6b45b None None] The sync data for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi is: [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '3b151f89-e762-4dda-b167-b739caf54bf7', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.21', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:23:30Z', 'updated_at': '2021-06-01T11:23:33Z', 'revision_number': 1, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}, {'id': 'c1bf70ff-3c83-423d-8e52-7daf61bf7889', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.71', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:e9:a2:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:25:24Z', 'updated_at': '2021-06-01T11:25:24Z', 'revision_number': 0, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:25:27.259209 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce048ff8-0ae2-49d7-b19d-a848eccb632d None None] New status for floating IP c1bf70ff-3c83-423d-8e52-7daf61bf7889: ACTIVE {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:25:27.799745 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:29.796654 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:25:46.929856 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:52.742854 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-55feb1d5-c3e8-46df-95bc-70b577a69cd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:55.271832 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-1d936845-b2b6-4bad-951b-35661536202a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:55.361973 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:56.460029 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:25:57.801520 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:06.795040 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:26:13.120389 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [req-deffc425-6c4c-4efc-86c8-b4266326d81b req-613eaf38-5783-473d-bd6c-5370ae2b176c service neutron] (119240) timed out ('10.222.0.79', 58739) {{(pid=119240) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 11:26:16.942116 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:22.744778 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-15696320-62f3-44ab-84d2-7959d4bc1695 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:23.786516 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-f21b2e71-b370-4ddb-8284-e99a4c99cd2d service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1688344
Jun 01 11:26:23.876413 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-aed782d3-7298-47a0-bf28-9511974137e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:23.877855 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-aed782d3-7298-47a0-bf28-9511974137e6 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 1098 time: 0.0706813
Jun 01 11:26:24.016334 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-72837e79-10ba-46eb-a93c-7070f3bc1263 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:24.017662 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-72837e79-10ba-46eb-a93c-7070f3bc1263 service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1222382
Jun 01 11:26:24.118800 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-e4b45d73-f149-435c-9c57-c3ca7a0fa626 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 HTTP/1.1" status: 200  len: 1000 time: 0.0944457
Jun 01 11:26:24.183049 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-c391060b-6eba-4644-9216-3f3b39285a47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:24.184454 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-c391060b-6eba-4644-9216-3f3b39285a47 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0594618
Jun 01 11:26:24.257637 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-f8d108f6-62e6-4b0c-97bc-1ff3956165b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:24.259075 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-f8d108f6-62e6-4b0c-97bc-1ff3956165b9 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0688128
Jun 01 11:26:24.389583 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-d6473434-6ff2-4369-97d7-8db1c1ebe949 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1240437
Jun 01 11:26:24.523016 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-28064cc2-14a3-495e-b53a-f9139d1b9b18 req-25e062e6-03b3-4708-ae8a-f1fbf33b4eb7 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1267138
Jun 01 11:26:25.277359 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-41fdc63a-3f60-4a1b-b825-7c8e55209f9c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:25.362907 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:26.459646 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:27.806726 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:43.793690 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:26:46.946720 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:47.772168 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40476) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:26:48.078015 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Deleting port 2fa56013-da3f-4fbc-b671-83c5a817ac28 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:26:48.078809 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:48.197435 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:48.197756 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:48.423273 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Calling delete_port for 2fa56013-da3f-4fbc-b671-83c5a817ac28 owned by network:floatingip {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:26:48.540917 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:48.545284 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-514257a7-1d79-408e-854f-1465adc42f04 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:26:48.592005 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event deleted for resources: {'Port': ['ID=2fa56013-da3f-4fbc-b671-83c5a817ac28,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:26:48.635999 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.636384 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.636760 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.637134 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.637499 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.637898 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.638266 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.638645 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.638995 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.639352 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.639740 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.640095 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119240) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:48.666947 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:26:48.696697 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:48.696962 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.db.l3_db [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Floating IP c1bf70ff-3c83-423d-8e52-7daf61bf7889 disassociated (deleted). External IP: 172.27.3.71, port: ecf21f5b-9805-4bf8-be60-e848dd9fb8c9.
Jun 01 11:26:49.048631 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Router a59f8c59-1a3a-4919-8e53-9db5a22f8dde has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:26:49.227335 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:26:49.237138 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] Sync routers for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:26:49.245963 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:26:49.246582 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579800fbe0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:26:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:26:49.247427 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:49.304457 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-cc19d50a-2262-4646-ad3b-828887780305 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "DELETE /v2.0/floatingips/c1bf70ff-3c83-423d-8e52-7daf61bf7889 HTTP/1.1" status: 204  len: 168 time: 1.5311029
Jun 01 11:26:49.305128 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9'}] {{(pid=119240) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:26:49.307635 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}059d8db5603b3607edb81345f14ab5606fb0ec34c025b1e5da2e726cef2fc78f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3" -d '{"events": [{"name": "network-changed", "server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9"}]}' {{(pid=119240) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:26:49.427758 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:26:49.540175 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:26:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d655dce-7f9f-425e-88e7-05f8dee0fe3c x-openstack-request-id: req-9d655dce-7f9f-425e-88e7-05f8dee0fe3c {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:26:49.540668 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9", "status": "completed", "code": 200}]} {{(pid=119240) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:26:49.541140 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-9d655dce-7f9f-425e-88e7-05f8dee0fe3c {{(pid=119240) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:26:49.541721 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'status': 'completed', 'code': 200}
Jun 01 11:26:49.694979 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-e2edd51f-6587-4dcd-82ec-fd2dcf57f2c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:49.696591 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-e2edd51f-6587-4dcd-82ec-fd2dcf57f2c1 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 1098 time: 0.1307330
Jun 01 11:26:49.788479 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579800fbe0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '3b151f89-e762-4dda-b167-b739caf54bf7', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.21', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:23:30Z', 'updated_at': '2021-06-01T11:23:33Z', 'revision_number': 1, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:26:49.792921 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8baf534d-d400-4b12-85c5-907fe95042ab req-e4c8ff4f-90b7-4737-8a16-9e3d142c9021 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:49.793730 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] Checking router: a59f8c59-1a3a-4919-8e53-9db5a22f8dde for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:26:49.794101 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8baf534d-d400-4b12-85c5-907fe95042ab req-e4c8ff4f-90b7-4737-8a16-9e3d142c9021 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 945 time: 0.1735685
Jun 01 11:26:49.804259 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:26:49.804872 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f579800fbe0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:26:25Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:26:49.872346 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8baf534d-d400-4b12-85c5-907fe95042ab req-b2225923-0166-4ae6-a0d0-21bdd8cdd5cf tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0705707
Jun 01 11:26:49.877411 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-215657f3-a053-4623-8194-4ea484a00eb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:49.878816 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-215657f3-a053-4623-8194-4ea484a00eb9 service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1737440
Jun 01 11:26:49.951987 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-7015d2c5-d82b-4828-9b86-e7a95683b2bf service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 HTTP/1.1" status: 200  len: 217 time: 0.0656714
Jun 01 11:26:50.013541 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-cc30c29d-b7a0-4f0e-ab9b-3a97fc7a3d8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:50.014993 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-cc30c29d-b7a0-4f0e-ab9b-3a97fc7a3d8d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0567937
Jun 01 11:26:50.061578 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:26:50.093937 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-64dea3be-c8e9-4ab4-b2a1-7cc06ab1f5cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:50.095412 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-64dea3be-c8e9-4ab4-b2a1-7cc06ab1f5cc service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0730088
Jun 01 11:26:50.231530 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-fda05700-ffd5-43af-a369-db7a5fda37ae service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1274662
Jun 01 11:26:50.469420 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-8f23f0cf-cfb3-4fbe-9426-b8e60aa032e3 req-fd17c62d-9e72-488b-8213-59123efddbbf service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2327647
Jun 01 11:26:50.547646 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f579800fbe0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '3b151f89-e762-4dda-b167-b739caf54bf7', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.21', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:23:30Z', 'updated_at': '2021-06-01T11:23:33Z', 'revision_number': 1, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:26:50.551412 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-666d93db-e55c-4b44-9546-6bbb30e5cd86 None None] The sync data for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi is: [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_floatingips': [{'id': '3b151f89-e762-4dda-b167-b739caf54bf7', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'floating_ip_address': '172.27.3.21', 'floating_network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'router_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'port_id': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'mac_address': 'fa:16:3e:10:3e:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T11:23:30Z', 'updated_at': '2021-06-01T11:23:33Z', 'revision_number': 1, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:26:50.756118 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ecccec8-5a13-4de4-b7c3-fcc7c639b4e5 None None] New status for floating IP c1bf70ff-3c83-423d-8e52-7daf61bf7889: DOWN {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:26:51.057335 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b2482c-7d42-4f53-a795-bc803484a395 req-31f62cf3-ab05-4e12-b143-9d5047f6aba7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:51.058759 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-57b2482c-7d42-4f53-a795-bc803484a395 req-31f62cf3-ab05-4e12-b143-9d5047f6aba7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 945 time: 0.0786796
Jun 01 11:26:51.151128 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-57b2482c-7d42-4f53-a795-bc803484a395 req-c7199097-ae61-497a-af8b-4583ff9eb84a tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0620174
Jun 01 11:26:51.172333 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-7a366de3-b641-459d-ba91-6518fd29447b tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:51.173726 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-7a366de3-b641-459d-ba91-6518fd29447b tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 945 time: 0.1141427
Jun 01 11:26:51.308252 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Deleting port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:26:51.308587 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:51.449119 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] For port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:26:51.449467 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:51.589163 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Calling delete_port for ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:26:51.705878 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:51.711764 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-0e00ca17-fd0b-4260-b601-cee104c0929e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:26:51.760370 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event deleted for resources: {'Port': ['ID=ecf21f5b-9805-4bf8-be60-e848dd9fb8c9,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:26:51.799693 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.800072 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.800437 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.800794 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.801149 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.801506 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.801854 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.802205 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.802556 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.802903 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.803248 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.803637 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119241) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:26:51.811082 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:26:51.858690 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] No DVR routers for this DVR port ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:26:51.862374 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:51.865030 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'name': 'network-vif-deleted', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:26:51.867293 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bc4ca2f7-0d0d-4d81-accb-a5bba2945c2b" -d '{"events": [{"server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "name": "network-vif-deleted", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:26:51.878046 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-922dd75d-d93c-4405-b15c-774de5eb8509 req-cff83083-5835-459f-86b8-4c35c565a4f2 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "DELETE /v2.0/ports/ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 HTTP/1.1" status: 204  len: 173 time: 0.6981177
Jun 01 11:26:51.916138 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:26:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-402c9e2f-eb4c-4d54-82ad-3c44a499a1af x-openstack-request-id: req-402c9e2f-eb4c-4d54-82ad-3c44a499a1af {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:26:51.916478 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d2d8009f-aa42-4cf7-a977-5930c72a89d1", "name": "network-vif-deleted", "tag": "ecf21f5b-9805-4bf8-be60-e848dd9fb8c9", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:26:51.916778 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-402c9e2f-eb4c-4d54-82ad-3c44a499a1af {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:26:51.917236 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd2d8009f-aa42-4cf7-a977-5930c72a89d1', 'name': 'network-vif-deleted', 'tag': 'ecf21f5b-9805-4bf8-be60-e848dd9fb8c9', 'status': 'completed', 'code': 200}
Jun 01 11:26:52.314800 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-903dc99a-ad62-4e00-bd13-4d223b811974 req-6e9780ed-0951-42e6-9d4e-1393c121eed0 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Synchronizing usage tracker for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:26:52.331376 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-903dc99a-ad62-4e00-bd13-4d223b811974 req-6e9780ed-0951-42e6-9d4e-1393c121eed0 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Unset dirty status for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:26:52.332782 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-903dc99a-ad62-4e00-bd13-4d223b811974 req-6e9780ed-0951-42e6-9d4e-1393c121eed0 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=d2d8009f-aa42-4cf7-a977-5930c72a89d1 HTTP/1.1" status: 200  len: 210 time: 0.0669875
Jun 01 11:26:52.746778 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a63145f4-daf3-4ef9-adb2-08ee8d0710d4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:53.715007 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:26:53.751823 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:26:53.752551 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device ecf21f5b-9805-4bf8-be60-e848dd9fb8c9 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:26:55.268910 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-3ef9b71c-30bb-4ae3-b856-2b6f03235922 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:55.369089 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:55.820349 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40510) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:26:56.084194 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Deleting port 16b2b6fe-14da-49be-8270-801b816ed1d8 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:26:56.084436 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:56.198618 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:56.198938 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:56.318027 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Calling delete_port for 16b2b6fe-14da-49be-8270-801b816ed1d8 owned by network:floatingip {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:26:56.463375 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:56.539000 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:56.543580 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-13496e13-1f0c-44de-9ec0-abf068cf4c2e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:26:56.589233 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event deleted for resources: {'Port': ['ID=16b2b6fe-14da-49be-8270-801b816ed1d8,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:26:56.615528 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:26:56.679753 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:56.680111 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.db.l3_db [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Floating IP 3b151f89-e762-4dda-b167-b739caf54bf7 disassociated (deleted). External IP: 172.27.3.21, port: b527bece-ae6b-498b-93fc-d35e31fffd95.
Jun 01 11:26:57.028962 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Router a59f8c59-1a3a-4919-8e53-9db5a22f8dde has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119241) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:26:57.213656 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119241) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:26:57.224814 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] Sync routers for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:26:57.233513 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:57.235033 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:26:57.235726 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5792f987f0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:26:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:26:57.290245 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-c6067f0b-f5d7-40d0-bed7-e26c97071edc tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "DELETE /v2.0/floatingips/3b151f89-e762-4dda-b167-b739caf54bf7 HTTP/1.1" status: 204  len: 168 time: 1.4664168
Jun 01 11:26:57.290245 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:26:57.290983 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0bf65958-8eea-42b8-b12c-4e080ad91af8" -d '{"events": [{"name": "network-changed", "server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:26:57.414556 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:26:57.523659 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 11:26:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8cb10ebb-7101-4ff5-9407-2ae7170915e8 x-openstack-request-id: req-8cb10ebb-7101-4ff5-9407-2ae7170915e8 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:26:57.524040 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:26:57.524356 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-8cb10ebb-7101-4ff5-9407-2ae7170915e8 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:26:57.524778 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'status': 'completed', 'code': 200}
Jun 01 11:26:57.677941 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-b077de31-9a5c-4cda-bf58-0f1a17f29e85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:57.679440 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-b077de31-9a5c-4cda-bf58-0f1a17f29e85 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 1098 time: 0.1317463
Jun 01 11:26:57.743037 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5792f987f0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:26:57.746806 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] Checking router: a59f8c59-1a3a-4919-8e53-9db5a22f8dde for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:26:57.755580 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:26:57.756205 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5792f987f0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:26:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:26:57.784445 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4085d255-bc61-471b-9a90-b60228d9926c req-70b1bd56-9a81-4563-b034-f230dd0f480e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:57.785140 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-4085d255-bc61-471b-9a90-b60228d9926c req-70b1bd56-9a81-4563-b034-f230dd0f480e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Synchronizing usage tracker for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:26:57.817942 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-4085d255-bc61-471b-9a90-b60228d9926c req-70b1bd56-9a81-4563-b034-f230dd0f480e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Unset dirty status for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:26:57.819095 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4085d255-bc61-471b-9a90-b60228d9926c req-70b1bd56-9a81-4563-b034-f230dd0f480e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 945 time: 0.2141223
Jun 01 11:26:57.843274 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:57.853127 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-87fe445f-3082-4e2e-bfcd-de57bec08f6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:57.854556 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-87fe445f-3082-4e2e-bfcd-de57bec08f6b service neutron] 10.222.0.79 "GET /v2.0/networks?id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 200  len: 913 time: 0.1675506
Jun 01 11:26:57.935647 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-7180bcfe-c173-473d-9883-07cc093673a7 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b527bece-ae6b-498b-93fc-d35e31fffd95 HTTP/1.1" status: 200  len: 217 time: 0.0702169
Jun 01 11:26:57.940893 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-4085d255-bc61-471b-9a90-b60228d9926c req-ea36f0ce-7034-401c-8037-4dbe310e92b6 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1099873
Jun 01 11:26:57.946393 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:26:57.997603 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-db198ae8-aec6-4b72-8457-094a0311a491 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:57.998941 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-db198ae8-aec6-4b72-8457-094a0311a491 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 200  len: 851 time: 0.0572236
Jun 01 11:26:58.078382 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-6e9dda8d-e308-4b18-b84d-e99220e89847 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:58.079920 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-6e9dda8d-e308-4b18-b84d-e99220e89847 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0740485
Jun 01 11:26:58.311093 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5792f987f0>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:26:58.315448 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a4accc4-c604-4d02-96a6-9c42780c2a26 None None] The sync data for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi is: [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:22Z', 'revision_number': 4, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi', '_interfaces': [{'id': '25dca142-5ab7-4214-a502-7b78c0f77cd2', 'name': '', 'network_id': '8234ed64-9e09-4fc8-a5b1-b67ff870ca9e', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'mac_address': 'fa:16:3e:8a:96:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:21Z', 'updated_at': '2021-06-01T11:20:27Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'subnets': [{'id': '241dacc7-1074-4a81-a1a4-074010054ea6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:26:58.330070 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-80aa8f04-9802-433a-a013-ec5574775414 service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2423086
Jun 01 11:26:58.464034 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-0bf65958-8eea-42b8-b12c-4e080ad91af8 req-27f007cc-31e1-4741-a6ce-aca35926e79d service neutron] 10.222.0.79 "GET /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1274478
Jun 01 11:26:58.533461 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af17cac-8422-498a-bbf7-28fe5e7bb37a None None] New status for floating IP 3b151f89-e762-4dda-b167-b739caf54bf7: DOWN {{(pid=119243) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 11:26:59.164180 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-1bf7fd5a-4478-4aad-8e30-be379e8fbbfb tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:59.165600 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-1bf7fd5a-4478-4aad-8e30-be379e8fbbfb tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 945 time: 0.1391840
Jun 01 11:26:59.172881 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-763962ef-2782-4a4c-9fbd-d3cee6249149 req-11ddf8bb-74ca-440f-9d31-22699fc4bf70 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=119241) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 11:26:59.174726 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-763962ef-2782-4a4c-9fbd-d3cee6249149 req-11ddf8bb-74ca-440f-9d31-22699fc4bf70 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 945 time: 0.1143231
Jun 01 11:26:59.303894 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-763962ef-2782-4a4c-9fbd-d3cee6249149 req-a9557697-1337-4a49-a42c-255ebf39784a tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/security-groups?id=647a42bf-905f-496c-95f8-7c300a6ee43c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1000822
Jun 01 11:26:59.344380 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Deleting port b527bece-ae6b-498b-93fc-d35e31fffd95 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:26:59.344716 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:59.479009 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.db [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] For port b527bece-ae6b-498b-93fc-d35e31fffd95, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b527bece-ae6b-498b-93fc-d35e31fffd95,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119241) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:26:59.479360 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:59.600987 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Calling delete_port for b527bece-ae6b-498b-93fc-d35e31fffd95 owned by compute:nova {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:26:59.713649 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:59.719984 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5f308b15-8b35-4e85-acc9-29e3f1dc65eb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:26:59.769010 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event deleted for resources: {'Port': ['ID=b527bece-ae6b-498b-93fc-d35e31fffd95,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:26:59.771548 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:26:59.845949 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.db.l3_dvrscheduler_db [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] No DVR routers for this DVR port b527bece-ae6b-498b-93fc-d35e31fffd95 on host hv-cinder-78776 {{(pid=119241) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:26:59.848303 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for port, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:26:59.850796 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'name': 'network-vif-deleted', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95'}] {{(pid=119241) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 11:26:59.853136 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.74/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02ec96a908cb60c0bb6ab421759715cfb3c51a3e62ca1bce1c6750fdfb06f748" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9bcf1088-10fb-4f65-9dd7-8d6a466b30ac" -d '{"events": [{"server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "name": "network-vif-deleted", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95"}]}' {{(pid=119241) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 11:26:59.867912 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-3136e33e-0d87-481c-8ffe-bfd7f05a423f req-dadb15db-88e1-4e66-a43e-c38dcf668c3e tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.79 "DELETE /v2.0/ports/b527bece-ae6b-498b-93fc-d35e31fffd95 HTTP/1.1" status: 204  len: 173 time: 0.6921573
Jun 01 11:26:59.897638 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 11:26:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47110bd2-ee57-4d92-953d-d593e30536e9 x-openstack-request-id: req-47110bd2-ee57-4d92-953d-d593e30536e9 {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 11:26:59.898034 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a666d1ef-cbbf-4a25-97e4-5321267c030e", "name": "network-vif-deleted", "tag": "b527bece-ae6b-498b-93fc-d35e31fffd95", "status": "completed", "code": 200}]} {{(pid=119241) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 11:26:59.898441 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.74/compute/v2.1/os-server-external-events used request id req-47110bd2-ee57-4d92-953d-d593e30536e9 {{(pid=119241) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 11:26:59.898929 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a666d1ef-cbbf-4a25-97e4-5321267c030e', 'name': 'network-vif-deleted', 'tag': 'b527bece-ae6b-498b-93fc-d35e31fffd95', 'status': 'completed', 'code': 200}
Jun 01 11:27:00.464304 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-34291f5f-3042-4004-a9eb-0216492126da req-1a521f25-3d53-469a-ae5e-d0baa0832cff tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Synchronizing usage tracker for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 11:27:00.480265 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.quota.resource [req-34291f5f-3042-4004-a9eb-0216492126da req-1a521f25-3d53-469a-ae5e-d0baa0832cff tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Unset dirty status for tenant:858ec485cd65427ca55a7bbfe0be5efe on resource:port {{(pid=119241) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 11:27:00.481508 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [req-34291f5f-3042-4004-a9eb-0216492126da req-1a521f25-3d53-469a-ae5e-d0baa0832cff tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "GET /v2.0/ports?device_id=a666d1ef-cbbf-4a25-97e4-5321267c030e HTTP/1.1" status: 200  len: 210 time: 0.0589597
Jun 01 11:27:01.573785 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40530) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:01.775393 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device b527bece-ae6b-498b-93fc-d35e31fffd95 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:27:01.793156 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Deleting port 4f2b93bc-54e8-400e-a1f9-28f90d4d5cd6 {{(pid=119241) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:27:01.793492 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:01.809810 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] No Port match for: b527bece-ae6b-498b-93fc-d35e31fffd95 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:27:01.810166 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Device b527bece-ae6b-498b-93fc-d35e31fffd95 not bound to the agent host hv-cinder-78776 {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:27:01.910593 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:01.910928 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:02.137104 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.plugins.ml2.plugin [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Calling delete_port for 4f2b93bc-54e8-400e-a1f9-28f90d4d5cd6 owned by network:floatingip {{(pid=119241) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:27:02.243899 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10959847'] for port, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:02.248192 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-5efefa27-a2c2-42fc-8b3e-f71fc3d31cb0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:02.293767 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event deleted for resources: {'Port': ['ID=4f2b93bc-54e8-400e-a1f9-28f90d4d5cd6,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:02.325359 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:02.382574 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for floatingip, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:02.400962 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-89130'] for floatingip, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:02.402021 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-12aeafe6-0840-4067-82cd-b2106f36170d tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "DELETE /v2.0/floatingips/6763735a-69c2-4f00-b658-64aa60dec8e3 HTTP/1.1" status: 204  len: 168 time: 0.8272691
Jun 01 11:27:03.764726 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [-] (119241) accepted ('10.222.0.74', 40544) {{(pid=119241) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:03.834793 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-121eec73-8bbe-4f52-b620-7000341979a7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group, before_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:03.865177 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-121eec73-8bbe-4f52-b620-7000341979a7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group, precommit_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:03.927623 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-121eec73-8bbe-4f52-b620-7000341979a7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:03.931373 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-05c1dca8-15c4-4ce8-b5c9-c4aeddf6ad0c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:03.947792 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-121eec73-8bbe-4f52-b620-7000341979a7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=647a42bf-905f-496c-95f8-7c300a6ee43c,revision_number=None']} {{(pid=119241) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:03.950575 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG oslo_concurrency.lockutils [None req-121eec73-8bbe-4f52-b620-7000341979a7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=119241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:03.960266 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron_lib.callbacks.manager [None req-121eec73-8bbe-4f52-b620-7000341979a7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] Notify callbacks [] for security_group, before_response {{(pid=119241) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:03.961422 dv-cinder-787764-3-iscsi neutron-server[119241]: INFO neutron.wsgi [None req-121eec73-8bbe-4f52-b620-7000341979a7 tempest-TestVolumeBootPattern-429408171 tempest-TestVolumeBootPattern-429408171-project] 10.222.0.74 "DELETE /v2.0/security-groups/647a42bf-905f-496c-95f8-7c300a6ee43c HTTP/1.1" status: 204  len: 168 time: 0.1956830
Jun 01 11:27:04.017404 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40550) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:04.778427 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-926124'] for router_interface, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:05.183458 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Deleting port 25dca142-5ab7-4214-a502-7b78c0f77cd2 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:27:05.184157 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:05.305590 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] For port 25dca142-5ab7-4214-a502-7b78c0f77cd2, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=25dca142-5ab7-4214-a502-7b78c0f77cd2,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:27:05.305969 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:05.429141 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Calling delete_port for 25dca142-5ab7-4214-a502-7b78c0f77cd2 owned by network:router_interface {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:27:05.710716 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:05.715100 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ff4b7fb5-13b8-431a-835a-7b41a38741a0 tempest-TestMinimumBasicScenario-1961887737 tempest-TestMinimumBasicScenario-1961887737-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:05.757930 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Pushing event deleted for resources: {'Port': ['ID=25dca142-5ab7-4214-a502-7b78c0f77cd2,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:05.788028 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:06.136865 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-776947', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-646716'] for router_interface, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:06.498687 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Router a59f8c59-1a3a-4919-8e53-9db5a22f8dde has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:27:06.674039 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:27:06.682156 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] Sync routers for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:27:06.686186 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] 10.222.0.74 "PUT /v2.0/routers/a59f8c59-1a3a-4919-8e53-9db5a22f8dde/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6676600
Jun 01 11:27:06.688784 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40556) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:06.692239 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:27:06.692894 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798778280>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:26:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:06.866673 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks [] for router, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:06.870178 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: dv-cinder-787764-3-iscsi {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:27:07.039813 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:07.116368 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Deleting port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:27:07.116596 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:07.157065 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798778280>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:27:05Z', 'revision_number': 5, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port': {'id': '55efbe93-08e3-4768-ac7b-d48d5ea5bb31', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:df:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:20:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:07.161549 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] Checking router: a59f8c59-1a3a-4919-8e53-9db5a22f8dde for host: dv-cinder-787764-3-iscsi {{(pid=119242) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:27:07.169903 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] Routers {'a59f8c59-1a3a-4919-8e53-9db5a22f8dde'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119242) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:27:07.170504 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f5798778280>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:26:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'], 'active': True} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:07.238283 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] For port 55efbe93-08e3-4768-ac7b-d48d5ea5bb31, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=55efbe93-08e3-4768-ac7b-d48d5ea5bb31,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:27:07.238709 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:07.318557 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvr_db [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] Set router a59f8c59-1a3a-4919-8e53-9db5a22f8dde gateway port host: None {{(pid=119242) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:27:07.361100 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Calling delete_port for 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 owned by network:router_gateway {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:27:07.423865 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_hamode_db [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f5798778280>, [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:27:07Z', 'revision_number': 6, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port_host': None}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119242) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:07.428106 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c129b2-3c52-44ac-91c3-5e9199159c33 None None] The sync data for ids ['a59f8c59-1a3a-4919-8e53-9db5a22f8dde'] in dv-cinder-787764-3-iscsi is: [{'id': 'a59f8c59-1a3a-4919-8e53-9db5a22f8dde', 'name': 'tempest-TestVolumeBootPattern-1842838909-router', 'tenant_id': '858ec485cd65427ca55a7bbfe0be5efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:18Z', 'updated_at': '2021-06-01T11:27:07Z', 'revision_number': 6, 'project_id': '858ec485cd65427ca55a7bbfe0be5efe', 'gw_port_host': None}] {{(pid=119242) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:27:07.620357 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:07.623816 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-bea57fbe-613e-439f-a757-680c11ce3fd5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:07.665575 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Pushing event deleted for resources: {'Port': ['ID=55efbe93-08e3-4768-ac7b-d48d5ea5bb31,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:07.669152 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:07.759630 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-645297'] for router_gateway, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:07.933993 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-643132', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4050'] for router, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:07.936190 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:07.959627 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-643584'] for router, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:07.960083 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Fanout notify agent at l3_agent the message router_deleted on router a59f8c59-1a3a-4919-8e53-9db5a22f8dde {{(pid=119240) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 11:27:07.971954 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:07.973134 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-c727196d-af6b-47cb-8c55-4963d477406b admin admin] 10.222.0.74 "DELETE /v2.0/routers/a59f8c59-1a3a-4919-8e53-9db5a22f8dde HTTP/1.1" status: 204  len: 168 time: 1.2832887
Jun 01 11:27:07.975631 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40560) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:08.034015 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-7edb21de-bc57-442b-be17-d6ee66710cc0 admin admin] Deleting subnet 241dacc7-1074-4a81-a1a4-074010054ea6 {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:27:08.036840 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7edb21de-bc57-442b-be17-d6ee66710cc0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.087230 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7edb21de-bc57-442b-be17-d6ee66710cc0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10700501'] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.165382 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7edb21de-bc57-442b-be17-d6ee66710cc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.422441 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7edb21de-bc57-442b-be17-d6ee66710cc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10700437', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-11313305'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.427634 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:08.461698 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7edb21de-bc57-442b-be17-d6ee66710cc0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=241dacc7-1074-4a81-a1a4-074010054ea6,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:08.463599 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-7edb21de-bc57-442b-be17-d6ee66710cc0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.466032 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-7edb21de-bc57-442b-be17-d6ee66710cc0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:08.467529 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3ba682b-748a-4bcb-add0-680b5ef57e37 None None] Network 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:27:08.470651 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-7edb21de-bc57-442b-be17-d6ee66710cc0 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/241dacc7-1074-4a81-a1a4-074010054ea6 HTTP/1.1" status: 204  len: 168 time: 0.4934871
Jun 01 11:27:08.473239 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40564) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:08.578207 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.652994 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Deleting port f0322668-1302-4ea0-aa95-18beae9d3646 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:27:08.653653 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.727929 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] DHCP port deletion for 8234ed64-9e09-4fc8-a5b1-b67ff870ca9e request from dv-cinder-787764-3-iscsi {{(pid=119242) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 11:27:08.759910 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] For port f0322668-1302-4ea0-aa95-18beae9d3646, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f0322668-1302-4ea0-aa95-18beae9d3646,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:27:08.760257 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.791959 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Deleting port f0322668-1302-4ea0-aa95-18beae9d3646 {{(pid=119242) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:27:08.792342 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.886413 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Calling delete_port for f0322668-1302-4ea0-aa95-18beae9d3646 owned by network:dhcp {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:27:08.889543 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f0322668-1302-4ea0-aa95-18beae9d3646 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:27:08.931550 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.936795 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8a2d9cd9-d3d7-4fb5-a771-6c8509fd756b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:08.973840 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] For port f0322668-1302-4ea0-aa95-18beae9d3646, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=f0322668-1302-4ea0-aa95-18beae9d3646,segment=NetworkSegment(4caee24c-4c25-4ae5-bbe3-00c9bec6902a),segment_id=4caee24c-4c25-4ae5-bbe3-00c9bec6902a)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:27:08.974160 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:08.983518 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] No DVR routers for this DVR port f0322668-1302-4ea0-aa95-18beae9d3646 on host dv-cinder-787764-3-iscsi {{(pid=119240) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:27:08.985717 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Pushing event deleted for resources: {'Port': ['ID=f0322668-1302-4ea0-aa95-18beae9d3646,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:09.014325 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:09.036714 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No active binding found for port f0322668-1302-4ea0-aa95-18beae9d3646 {{(pid=119242) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}}
Jun 01 11:27:09.037129 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device f0322668-1302-4ea0-aa95-18beae9d3646 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:27:09.037552 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 25dca142-5ab7-4214-a502-7b78c0f77cd2 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:27:09.104395 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:09.116891 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f5798bc7f70>,) {'filters': {'network_id': ['8234ed64-9e09-4fc8-a5b1-b67ff870ca9e']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:09.128634 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f5798bc7f70>, '4caee24c-4c25-4ae5-bbe3-00c9bec6902a') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:09.128841 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Calling delete_port for f0322668-1302-4ea0-aa95-18beae9d3646 owned by network:dhcp {{(pid=119242) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:27:09.128953 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f5798bc7f70>, '4caee24c-4c25-4ae5-bbe3-00c9bec6902a') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:09.131066 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 25dca142-5ab7-4214-a502-7b78c0f77cd2 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:27:09.131416 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 25dca142-5ab7-4214-a502-7b78c0f77cd2 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:27:09.131900 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:27:09.140203 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:09.162254 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:09.168672 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Releasing vlan 689 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:27:09.169085 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:09.171093 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:27:09.171446 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 55efbe93-08e3-4768-ac7b-d48d5ea5bb31 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:27:09.182201 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:27:09.209864 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676'] for port, after_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:09.213442 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-14608c9c-15ca-4eea-90c8-c892f751af56 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:09.254665 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Pushing event deleted for resources: {'Port': ['ID=f0322668-1302-4ea0-aa95-18beae9d3646,revision_number=None']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:09.257563 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:09.261294 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:09.263715 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] No DVR routers for this DVR port f0322668-1302-4ea0-aa95-18beae9d3646 on host dv-cinder-787764-3-iscsi {{(pid=119242) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:27:09.265733 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.266083 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.266418 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.266811 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.267143 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.267548 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.267805 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.268120 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.268450 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.268757 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.269073 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.269391 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-3-iscsi {{(pid=119242) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 11:27:09.272781 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-b8aa5a33-03af-493a-a0e6-11906b5a3089 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:09.274423 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:09.285241 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Pushing event deleted for resources: {'Network': ['ID=8234ed64-9e09-4fc8-a5b1-b67ff870ca9e,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:09.288359 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:09.298569 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-8979ad3a-2aef-4d46-8e81-60ef97799021 admin admin] 10.222.0.74 "DELETE /v2.0/networks/8234ed64-9e09-4fc8-a5b1-b67ff870ca9e HTTP/1.1" status: 204  len: 168 time: 0.8243210
Jun 01 11:27:09.301395 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40568) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:09.913257 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-926124'] for router_interface, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:10.314977 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Deleting port 0a49873a-c8d9-47b7-b05f-fd20555fff3c {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:27:10.315319 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:10.435078 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] For port 0a49873a-c8d9-47b7-b05f-fd20555fff3c, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=0a49873a-c8d9-47b7-b05f-fd20555fff3c,segment=NetworkSegment(5067a62f-c732-4b9f-8f48-d348815b4148),segment_id=5067a62f-c732-4b9f-8f48-d348815b4148)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:27:10.435530 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:10.557747 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Calling delete_port for 0a49873a-c8d9-47b7-b05f-fd20555fff3c owned by network:router_interface {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:27:10.703657 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:10.707882 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-76de0d9d-96cb-4eed-8bcb-3a1408c19733 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:10.753682 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Pushing event deleted for resources: {'Port': ['ID=0a49873a-c8d9-47b7-b05f-fd20555fff3c,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:10.756765 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:11.118549 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-776947', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-646716'] for router_interface, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:11.471749 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 has already been hosted by L3 agent 12eae1e3-1574-4788-9e98-b05c5610f03e {{(pid=119240) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 11:27:11.647195 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] Notify agent at l3_agent.dv-cinder-787764-3-iscsi the message routers_updated {{(pid=119240) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 11:27:11.656237 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] Sync routers for ids ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'] in dv-cinder-787764-3-iscsi {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 11:27:11.663381 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-dac269d9-4394-4320-8d10-a69c76b564d1 admin admin] 10.222.0.74 "PUT /v2.0/routers/81cd47a2-af4e-4f4e-87fa-f2733c4a3f78/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.3609388
Jun 01 11:27:11.665677 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] Routers {'81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:27:11.666118 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40576) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:11.666273 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57986bddc0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:26:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:11.838624 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks [] for router, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:11.839488 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] Set router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 gateway port host: dv-cinder-787764-3-iscsi {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:27:12.012180 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:12.083299 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Deleting port 722afba1-9696-48e5-9935-e00a37635c9d {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:27:12.083667 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:12.159277 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57986bddc0>, [{'id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'external_fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '722afba1-9696-48e5-9935-e00a37635c9d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:24Z', 'updated_at': '2021-06-01T11:27:10Z', 'revision_number': 5, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'gw_port': {'id': '722afba1-9696-48e5-9935-e00a37635c9d', 'name': '', 'network_id': '75238de6-1437-4113-aa89-3deeb50d4603', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:dd:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T11:20:25Z', 'updated_at': '2021-06-01T11:20:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3393ce80-c770-4ca6-8844-f1f0c4351344', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-3-iscsi'}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:12.163796 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] Checking router: 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 for host: dv-cinder-787764-3-iscsi {{(pid=119243) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 11:27:12.176297 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] Routers {'81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'} bound to L3 agent in host dv-cinder-787764-3-iscsi {{(pid=119243) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 11:27:12.176932 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f57986bddc0>, 'dv-cinder-787764-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T11:01:25Z,description=<?>,heartbeat_timestamp=2021-06-01T11:26:55Z,host='dv-cinder-787764-3-iscsi',id=12eae1e3-1574-4788-9e98-b05c5610f03e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T11:01:25Z,topic='l3_agent')) {'router_ids': ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'], 'active': True} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:12.314808 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] For port 722afba1-9696-48e5-9935-e00a37635c9d, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=722afba1-9696-48e5-9935-e00a37635c9d,segment=NetworkSegment(abf878e1-d747-4b28-bf0b-78bc0965f02b),segment_id=abf878e1-d747-4b28-bf0b-78bc0965f02b)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:27:12.315455 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:12.323333 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_dvr_db [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] Set router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 gateway port host: None {{(pid=119243) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 11:27:12.429324 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.l3_hamode_db [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f57986bddc0>, [{'id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:24Z', 'updated_at': '2021-06-01T11:27:12Z', 'revision_number': 6, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'gw_port_host': None}], 'dv-cinder-787764-3-iscsi', False) {} {{(pid=119243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:12.433297 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6766e266-9d99-46a5-992a-824ac34e7bd9 None None] The sync data for ids ['81cd47a2-af4e-4f4e-87fa-f2733c4a3f78'] in dv-cinder-787764-3-iscsi is: [{'id': '81cd47a2-af4e-4f4e-87fa-f2733c4a3f78', 'name': 'tempest-TestVolumeBootPattern-948886587-router', 'tenant_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T11:20:24Z', 'updated_at': '2021-06-01T11:27:12Z', 'revision_number': 6, 'project_id': 'b0898f5cd58046c4a3a5343c0ec03baf', 'gw_port_host': None}] {{(pid=119243) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 11:27:12.440092 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Calling delete_port for 722afba1-9696-48e5-9935-e00a37635c9d owned by network:router_gateway {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:27:12.576553 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:12.581605 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-030e56a2-8e9b-45b2-8a81-44dac98e34ba tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:12.628349 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Pushing event deleted for resources: {'Port': ['ID=722afba1-9696-48e5-9935-e00a37635c9d,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:12.654904 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:12.717350 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-645297'] for router_gateway, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:12.898424 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-643132', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4050'] for router, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:12.900873 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:12.922070 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-643584'] for router, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:12.922566 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 {{(pid=119240) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 11:27:12.934725 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] Notify callbacks [] for router, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:12.935869 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-9d280c37-3812-4e36-87bb-b493de317e0a admin admin] 10.222.0.74 "DELETE /v2.0/routers/81cd47a2-af4e-4f4e-87fa-f2733c4a3f78 HTTP/1.1" status: 204  len: 168 time: 1.2687483
Jun 01 11:27:12.939214 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40582) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:13.000152 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.db_base_plugin_v2 [None req-59b3acfe-6692-4e63-806f-fb71934dd492 admin admin] Deleting subnet 8bc83fa9-97e8-499c-895a-f82b2a17fdac {{(pid=119240) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 11:27:13.002599 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-59b3acfe-6692-4e63-806f-fb71934dd492 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.051027 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-59b3acfe-6692-4e63-806f-fb71934dd492 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10700501'] for subnet, precommit_delete_associations {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.131867 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-59b3acfe-6692-4e63-806f-fb71934dd492 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4138193'] for subnet, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.175382 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 0a49873a-c8d9-47b7-b05f-fd20555fff3c no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:27:13.211536 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 0a49873a-c8d9-47b7-b05f-fd20555fff3c {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:27:13.211960 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 0a49873a-c8d9-47b7-b05f-fd20555fff3c not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:27:13.384195 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-59b3acfe-6692-4e63-806f-fb71934dd492 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4143204', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123460', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10700437', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-11313305'] for subnet, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.391880 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:13.429995 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-59b3acfe-6692-4e63-806f-fb71934dd492 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for subnet, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.432239 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94429c2f-9037-416e-98c2-4287d9d6c931 None None] Network 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 requested from dv-cinder-787764-3-iscsi {{(pid=119242) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 11:27:13.432451 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b3acfe-6692-4e63-806f-fb71934dd492 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8bc83fa9-97e8-499c-895a-f82b2a17fdac,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:13.435304 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-59b3acfe-6692-4e63-806f-fb71934dd492 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:13.438378 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-59b3acfe-6692-4e63-806f-fb71934dd492 admin admin] 10.222.0.74 "DELETE /v2.0/subnets/8bc83fa9-97e8-499c-895a-f82b2a17fdac HTTP/1.1" status: 204  len: 168 time: 0.4982059
Jun 01 11:27:13.441409 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40588) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:13.546262 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3754917'] for network, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.618829 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Deleting port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 {{(pid=119240) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:27:13.619162 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.675450 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] DHCP port deletion for 7fab40d6-3e77-414f-b4ba-e1447d0e6e78 request from dv-cinder-787764-3-iscsi {{(pid=119242) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 11:27:13.743209 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] Deleting port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 {{(pid=119242) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 11:27:13.743615 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750888643395'] for port, before_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.821488 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.db [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] For port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=6df9bb0c-22b5-4cf7-a92c-bf9e126a1682,segment=NetworkSegment(5067a62f-c732-4b9f-8f48-d348815b4148),segment_id=5067a62f-c732-4b9f-8f48-d348815b4148)] {{(pid=119240) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:27:13.821758 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.844753 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.db [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] For port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682, host dv-cinder-787764-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-3-iscsi',level=0,port_id=6df9bb0c-22b5-4cf7-a92c-bf9e126a1682,segment=NetworkSegment(5067a62f-c732-4b9f-8f48-d348815b4148),segment_id=5067a62f-c732-4b9f-8f48-d348815b4148)] {{(pid=119242) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 11:27:13.845213 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927613'] for port, precommit_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.948983 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.plugin [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Calling delete_port for 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 owned by network:dhcp {{(pid=119240) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:27:13.965802 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] Calling delete_port for 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 owned by network:dhcp {{(pid=119242) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 11:27:13.993574 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10646118'] for port, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:13.998527 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f7224f12-1da1-4116-aa59-34ab4b8bd3b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:14.007068 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-4116170', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-123481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-776929', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750888646310', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750888211676'] for port, after_delete {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.010604 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-11c3981b-5871-41ce-896e-4e5b1d53d4d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:14.047601 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Pushing event deleted for resources: {'Port': ['ID=6df9bb0c-22b5-4cf7-a92c-bf9e126a1682,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:14.052146 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] No DVR routers for this DVR port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 on host dv-cinder-787764-3-iscsi {{(pid=119240) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:27:14.053625 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:14.059921 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] Pushing event deleted for resources: {'Port': ['ID=6df9bb0c-22b5-4cf7-a92c-bf9e126a1682,revision_number=None']} {{(pid=119242) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:14.064352 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG oslo_concurrency.lockutils [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=119242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:14.066644 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57daf1c2-69e6-43c6-bbe5-b9666d16aaca None None] No DVR routers for this DVR port 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 on host dv-cinder-787764-3-iscsi {{(pid=119242) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 11:27:14.168817 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4141150', 'neutron.services.segments.db._delete_segments_for_network-8750888656348'] for network, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.181429 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f5792795c70>,) {'filters': {'network_id': ['7fab40d6-3e77-414f-b4ba-e1447d0e6e78']}} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:14.193271 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f5792795c70>, '5067a62f-c732-4b9f-8f48-d348815b4148') {'for_net_delete': True} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:14.193562 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.services.segments.db [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f5792795c70>, '5067a62f-c732-4b9f-8f48-d348815b4148') {} {{(pid=119240) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 11:27:14.205293 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750888664989', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10700510'] for segment, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.222184 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750'] for segment, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.228229 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Releasing vlan 678 on physical network physnet1 to pool {{(pid=119240) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 11:27:14.228617 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4139750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10646067'] for segment, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]: Traceback (most recent call last):
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     timer()
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     cb(*args, **kw)
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     return func(*args, **kwargs)
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     self._notify()
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     self.callback(batched_events)
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     event.method(event)
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     return f(self, *a, **k)
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._get(url).json()
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     return self.request(url, 'GET', **kwargs)
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 11:27:14.241666 dv-cinder-787764-3-iscsi neutron-server[119240]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 11:27:14.318824 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4141143', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-985677', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-776954', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-645292'] for network, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.323457 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-776927'] for network, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.325925 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-f914db94-f157-406c-87b8-47bb46fe085a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:14.349245 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Pushing event deleted for resources: {'Network': ['ID=7fab40d6-3e77-414f-b4ba-e1447d0e6e78,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:14.351495 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:14.355228 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5b13ed55-4ccd-4e05-919f-c456ad7710a8 admin admin] 10.222.0.74 "DELETE /v2.0/networks/7fab40d6-3e77-414f-b4ba-e1447d0e6e78 HTTP/1.1" status: 204  len: 168 time: 0.9129231
Jun 01 11:27:14.463642 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40594) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:14.515889 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-05add089-a07e-4f00-99ef-30270db23b1f admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=858ec485cd65427ca55a7bbfe0be5efe&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0509851
Jun 01 11:27:14.519146 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40598) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:14.577003 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5ff59b5a-bace-44f5-993d-51bd70bc0992 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.602106 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5ff59b5a-bace-44f5-993d-51bd70bc0992 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.655935 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5ff59b5a-bace-44f5-993d-51bd70bc0992 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.661141 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-ff0b7a6f-6d2f-4b94-813a-bed8be9e779f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:14.676334 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff59b5a-bace-44f5-993d-51bd70bc0992 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c640255a-ffef-4df4-95fb-956b677e31ba,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:14.679211 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-5ff59b5a-bace-44f5-993d-51bd70bc0992 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:14.681114 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-5ff59b5a-bace-44f5-993d-51bd70bc0992 admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:14.682224 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-5ff59b5a-bace-44f5-993d-51bd70bc0992 admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/c640255a-ffef-4df4-95fb-956b677e31ba HTTP/1.1" status: 204  len: 168 time: 0.1621356
Jun 01 11:27:14.858787 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 722afba1-9696-48e5-9935-e00a37635c9d no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:27:14.895068 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 722afba1-9696-48e5-9935-e00a37635c9d {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:27:14.895422 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 722afba1-9696-48e5-9935-e00a37635c9d not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:27:14.895865 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 no longer exists at agent ovs-agent-dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 11:27:14.928250 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.plugin [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] No Port match for: 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 {{(pid=119242) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 11:27:14.928600 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron.plugins.ml2.rpc [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Device 6df9bb0c-22b5-4cf7-a92c-bf9e126a1682 not bound to the agent host dv-cinder-787764-3-iscsi {{(pid=119242) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 11:27:15.050806 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40606) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:15.098703 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-bbab998a-2e74-4c80-8e0d-05c2679c8c7a admin admin] 10.222.0.74 "GET /v2.0/security-groups?tenant_id=b0898f5cd58046c4a3a5343c0ec03baf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0466013
Jun 01 11:27:15.100954 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [-] (119240) accepted ('10.222.0.74', 40610) {{(pid=119240) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 11:27:15.161001 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9991df1c-2c66-4401-b802-677a84d01f1e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:15.186339 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9991df1c-2c66-4401-b802-677a84d01f1e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:15.236904 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9991df1c-2c66-4401-b802-677a84d01f1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-985713'] for security_group, after_delete {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:15.241733 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-b1c3c9aa-b431-44b5-8af0-f48542b35376 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 11:27:15.255840 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9991df1c-2c66-4401-b802-677a84d01f1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb46adb9-7ae8-4f09-ba63-739534fe7c3a,revision_number=None']} {{(pid=119240) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 11:27:15.258106 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG oslo_concurrency.lockutils [None req-9991df1c-2c66-4401-b802-677a84d01f1e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=119240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 11:27:15.259502 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron_lib.callbacks.manager [None req-9991df1c-2c66-4401-b802-677a84d01f1e admin admin] Notify callbacks [] for security_group, before_response {{(pid=119240) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:15.260637 dv-cinder-787764-3-iscsi neutron-server[119240]: INFO neutron.wsgi [None req-9991df1c-2c66-4401-b802-677a84d01f1e admin admin] 10.222.0.74 "DELETE /v2.0/security-groups/bb46adb9-7ae8-4f09-ba63-739534fe7c3a HTTP/1.1" status: 204  len: 168 time: 0.1587634
Jun 01 11:27:16.950205 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:20.791725 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:27:22.748607 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6fa16fda-e4f6-4a09-aa3c-396a52c5f8de None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:25.274514 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-80505ab5-54f3-4941-b025-590b58153cbe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:25.362043 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:26.465251 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:27.814565 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:47.181118 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:52.751000 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-65cb6376-a353-4ee7-8f29-e79a0e42e028 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:55.266730 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-eaa31c46-1f6a-4d84-b928-a8ddef71a396 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:55.363803 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:56.469496 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:27:57.791531 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:27:57.815729 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:02.897665 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [req-a039b468-681b-48b1-82c0-43c9eeb7fa76 req-3c8ce211-dbf2-45b3-9dfb-414e916ffba8 service neutron] (119240) timed out ('10.222.0.79', 58742) {{(pid=119240) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 11:28:16.959155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:22.751269 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-d4ad8db0-5d17-4a69-87d2-7c55960d15a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:25.267818 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-c8e7a78d-415d-4009-9db7-1eae2366d76b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:25.366497 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:26.472286 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:27.818031 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:34.790356 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:28:46.973412 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:52.752223 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e6d9fb67-1fa7-4d7e-81bc-0dc25b53c901 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:55.485394 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-29a5889d-d14a-477c-a469-4f71862073b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:55.487196 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:56.473019 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:28:57.822340 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:11.789512 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:29:16.991944 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:22.753259 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-e985a6d1-9173-44e5-be82-50cc2f767d03 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:25.266837 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7db0b00e-4f43-4914-8ed2-10ca7f409f5a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:25.369282 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:26.476132 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:27.827659 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:47.024994 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:48.789619 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:29:52.754674 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-54aa8971-5c11-44b4-91f3-2593495c64b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:55.269046 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-053f3462-55bc-4f74-89b9-f753d2ebd47d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:55.370692 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:56.480328 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:29:57.827536 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:09.751303 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [req-4b33e631-9216-404e-a66f-672bf98ec6e7 req-3223c4dc-9c64-413d-98aa-d4456dfb797c tempest-AttachVolumeNegativeTest-1650444426 tempest-AttachVolumeNegativeTest-1650444426-project] (119241) timed out ('10.222.0.79', 58702) {{(pid=119241) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 11:30:17.024648 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:22.756922 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-3712c5aa-b0fb-479e-b55b-58eca0846ee3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:25.271279 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ac7e7c00-8566-4933-bc1d-43c636641923 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:25.373146 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:25.788103 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:30:26.484205 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:27.832597 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:47.036313 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:51.005320 dv-cinder-787764-3-iscsi neutron-server[119240]: DEBUG neutron.wsgi [req-d945d966-3e12-4f24-8aad-4735a93b2306 req-7cf38017-54f0-48c7-b701-48bffc5775f3 service neutron] (119240) timed out ('10.222.0.74', 37878) {{(pid=119240) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 11:30:52.758428 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6edd7f10-be0c-4b52-bc2c-71c5c04e09d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:55.273317 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-af6a6e89-93a7-440d-b2ad-80a4c68633e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:55.374077 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:56.485434 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:30:57.834720 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:02.786566 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:31:17.035345 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:22.760641 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-6b0ecb6d-7da8-4533-96b1-918043e6bda4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:25.274483 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a6d90be7-6e0d-4977-b8da-000d9605573e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:25.374756 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:26.487154 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:27.840196 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:39.785615 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:31:47.065510 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:52.762827 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-7f3d563e-ffef-4b66-8145-060167e9729d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:55.276479 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-aee499e3-a8e9-4d8e-877e-d1282971370c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:55.375737 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:56.492086 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:31:57.840616 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:32:16.785378 dv-cinder-787764-3-iscsi neutron-server[119243]: DEBUG neutron.db.agents_db [None req-0ebac3b0-d5bd-4a9d-a72e-ad200f5ba84f None None] Agent healthcheck: found 6 active agents {{(pid=119243) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 11:32:17.072482 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-a8e9721f-09af-42fc-ac30-f5822bea7571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:32:22.766155 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-ae4926e0-cfe1-4c36-b9a6-23af166a7a13 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:32:25.277216 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-80c5056e-37b5-450d-b4f2-6032ca709dcf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:32:25.377575 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-9075ecd5-78d3-4f1b-8d32-11806f7c6dfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:32:26.494919 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-afde3614-9d53-4910-bfa0-52ccc5950eb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:32:27.845805 dv-cinder-787764-3-iscsi neutron-server[119242]: DEBUG neutron_lib.callbacks.manager [None req-870e3426-6993-46f4-b8a4-13ad0977c549 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750888656366', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4131216'] for agent, after_update {{(pid=119242) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 11:32:29.297968 dv-cinder-787764-3-iscsi neutron-server[119241]: DEBUG neutron.wsgi [req-bd8e422f-8198-4d54-9e6c-8f0a7fad0439 req-59d1d9f4-1ff2-441b-b7d1-f112acb95584 tempest-TestShelveInstance-229005625 tempest-TestShelveInstance-229005625-project] (119241) timed out ('10.222.0.74', 56740) {{(pid=119241) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}